00010000:00010000:1.0F:1788528635.838749:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0F:1788528636.094933:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc455d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735573760:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788528636.095015:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528636.095065:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788528636.095071:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc455d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735573632:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788528636.095094:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528636.095121:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735573632 00000100:00100000:3.0:1788528636.095128:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735573632 00000100:00100000:3.0:1788528636.095177:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788528636.095188:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735573632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788528636.095216:0:18648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915845632 avail 3684323328 00000100:00100000:3.0:1788528636.095261:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735573632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528636.095268:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1788528636.095294:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788528636.095338:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc455d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735573632:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788528636.095375:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735573760 00000100:00100000:3.0:1788528636.095379:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735573760 00000100:00100000:3.0:1788528636.095406:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788528636.095412:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735573760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788528636.095435:0:17143:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788528636.095473:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735573760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528636.095479:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788528636.095513:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc455d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735573760:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0F:1788528636.101392:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6ef6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735573376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788528636.101473:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528636.101665:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735574016:0@lo:400:kworker.0 00000100:00100000:0.0:1788528636.101694:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528636.101714:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735574528:0@lo:400:kworker.0 00000100:00100000:0.0:1788528636.101737:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528636.101755:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4472a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1875407735575040:0@lo:400:kworker.0 00000100:00100000:0.0:1788528636.101774:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528636.101810:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1788528636.101826:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:463b8984-c30b-4b73-b2f1-81113bd4e10a:3640:1875407735573504:0@lo:400:kworker.0 00000100:00100000:0.0:1788528636.101857:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528636.101884:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735573888:0@lo:400:kworker.0 00000100:00100000:0.0:1788528636.101905:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0F:1788528636.101979:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735573504 00000100:00100000:2.0:1788528636.101994:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735573504 00000100:00100000:2.0:1788528636.102040:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788528636.102051:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ec8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+27:3640:x1875407735573504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528636.102086:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735574400:0@lo:400:kworker.0 00000100:00100000:2.0:1788528636.102107:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ec8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:463b8984-c30b-4b73-b2f1-81113bd4e10a+27:3640:x1875407735573504:12345-0@lo:400:kworker.0 Request processed in 56us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528636.102116:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788528636.102126:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528636.102149:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4472680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1875407735574912:0@lo:400:kworker.0 00000100:00100000:0.0:1788528636.102177:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528636.102179:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735574528 00000100:00100000:2.0:1788528636.102185:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735574528 00000100:00100000:2.0:1788528636.102212:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735575040 00000100:00100000:2.0:1788528636.102215:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735575040 00000100:00100000:0.0:1788528636.106468:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:463b8984-c30b-4b73-b2f1-81113bd4e10a:3640:1875407735573504:0@lo:400:kworker.0 00000100:00100000:0.0:1788528636.106525:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735574912 00000100:00100000:0.0:1788528636.106533:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735574912 00000100:00100000:0.0:1788528636.106600:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788528636.106609:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4471500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735574528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528636.106687:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4471500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735574528:12345-0@lo:400:kworker.0 Request processed in 79us (4948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528636.106694:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788528636.106721:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788528636.106728:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4473800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875407735575040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528636.106760:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4473800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875407735575040:12345-0@lo:400:kworker.0 Request processed in 33us (4985us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528636.106766:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788528636.106790:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788528636.106797:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875407735574912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528636.106824:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875407735574912:12345-0@lo:400:kworker.0 Request processed in 28us (4648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528636.106829:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788528636.106887:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4472680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1875407735574912:0@lo:400:kworker.0 00000100:00100000:0.0:1788528636.106902:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735574528:0@lo:400:kworker.0 00010000:00080000:0.0:1788528636.106913:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc4472a00 x1875407735575040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528636.106922:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4472a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1875407735575040:0@lo:400:kworker.0 00000100:00100000:0.0:1788528636.106969:0:19172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735574016 00000100:00100000:0.0:1788528636.106973:0:19172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735574016 00000100:00100000:0.0:1788528636.107004:0:19172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735573888 00000100:00100000:0.0:1788528636.107006:0:19172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735573888 00000100:00100000:0.0:1788528636.107018:0:19172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735574400 00000100:00100000:0.0:1788528636.107021:0:19172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735574400 00000100:00100000:0.0:1788528636.107033:0:19172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788528636.107039:0:19172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735574016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528636.107076:0:19172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735574016:12345-0@lo:400:kworker.0 Request processed in 36us (5381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528636.107092:0:19172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788528636.107105:0:19172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788528636.107110:0:19172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4470a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735573888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528636.107143:0:19172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4470a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735573888:12345-0@lo:400:kworker.0 Request processed in 33us (5237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528636.107148:0:19172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788528636.107159:0:19172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788528636.107164:0:19172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4473100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735574400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528636.107189:0:19172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4473100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735574400:12345-0@lo:400:kworker.0 Request processed in 25us (5065us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528636.107195:0:19172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788528636.107223:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735573888:0@lo:400:kworker.0 00000100:00100000:0.0:1788528636.107234:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735574400:0@lo:400:kworker.0 00000100:00100000:0.0:1788528636.107243:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:0.0:1788528636.107249:0:3640:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a90fe690380, transno 8589934596 00000004:00080000:0.0:1788528636.107262:0:3640:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:0.0:1788528636.107278:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735574016:0@lo:400:kworker.0 00000100:00100000:3.0:1788528636.112206:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875407735574144:0@lo:400:kworker.0 00000100:00100000:3.0:1788528636.112290:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528636.112366:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6fed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1875407735574656:0@lo:400:kworker.0 00000100:00100000:3.0:1788528636.112399:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528636.112445:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735574144 00000100:00100000:3.0:1788528636.112448:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788528636.112456:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735574144 00000100:00100000:3.0:1788528636.112457:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc467f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735574272:0@lo:400:kworker.0 00000100:00100000:3.0:1788528636.112495:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528636.112511:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735574656 00000100:00100000:0.0:1788528636.112516:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735574656 00000100:00100000:3.0:1788528636.112522:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1875407735574784:0@lo:400:kworker.0 00000100:00100000:3.0:1788528636.112549:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528636.112577:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788528636.112588:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875407735574144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528636.112602:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735574784 00000100:00100000:3.0:1788528636.112608:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735574784 00000100:00100000:3.0:1788528636.112642:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788528636.112652:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc455d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875407735574656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528636.112657:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875407735574144:12345-0@lo:400:kworker.0 Request processed in 69us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528636.112674:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788528636.112694:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc455d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875407735574656:12345-0@lo:400:kworker.0 Request processed in 44us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528636.112697:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788528636.112710:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788528636.112711:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875407735574784:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788528636.112732:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788528636.112739:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788528636.112742:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788528636.112754:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875407735574784:12345-0@lo:400:kworker.0 Request processed in 47us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528636.112755:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735574272 00000100:00100000:3.0:1788528636.112761:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735574272 00000100:00100000:0.0:1788528636.112765:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788528636.112803:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788528636.112811:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735574272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528636.112826:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735573376 00000100:00100000:0.0:1788528636.112831:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735573376 00000100:00100000:3.0:1788528636.112850:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735574272:12345-0@lo:400:kworker.0 Request processed in 39us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528636.112857:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788528636.112883:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788528636.112890:0:18647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4472d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735573376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788528636.112906:0:18647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915845632 avail 3684323328 00000100:00100000:3.0:1788528636.112952:0:18647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4472d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735573376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (11479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528636.112959:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788528636.112994:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735574272:0@lo:400:kworker.0 00010000:00080000:3.0:1788528636.113006:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90fe692300 x1875407735574784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528636.113015:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1875407735574784:0@lo:400:kworker.0 00000100:00100000:3.0:1788528636.113024:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc467df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875407735574144:0@lo:400:kworker.0 00000100:00100000:3.0:1788528636.113032:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6fed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1875407735574656:0@lo:400:kworker.0 00000100:00100000:3.0:1788528636.113072:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6ef6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735573376:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1788528636.619721:0:17117:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:0.0:1788528636.619742:0:17117:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a90c82bd180 refcount 2 committed 0 result 0 batchid 4294967530 00000020:00080000:0.0:1788528636.619747:0:17117:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a90c3de7b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a90de6c4b40 00000020:00080000:0.0:1788528636.619751:0:17117:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a90c3de7a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a90fb0c9000 00010000:00010000:1.0:1788528636.619836:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2600/0x892c60dda91c933d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528636.619849:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2600/0x892c60dda91c933d lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528636.619859:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2600/0x892c60dda91c933d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528636.619866:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc26e2600 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528636.619871:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2600/0x892c60dda91c933d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528636.619879:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2600/0x892c60dda91c933d lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528636.619903:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a90c87be400) 00010000:00010000:1.0:1788528636.619907:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788528636.619912:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2600/0x892c60dda91c933d lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528636.619926:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2600/0x892c60dda91c933d lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788528636.620184:0:17177:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967530 committed batchid 8 00000020:00080000:2.0:1788528636.620255:0:17177:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:3.0:1788528636.805871:0:17889:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788528636.862811:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528637.888408:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528638.171357:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528638.171409:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528638.171509:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528638.171573:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719771136 00000100:00100000:0.0:1788528638.171587:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719771136 00000100:00100000:0.0:1788528638.171652:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 184 00000100:00100000:0.0:1788528638.171663:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ec9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1823b577-e6d1-43c4-8232-3cf51fabc1da+14:2404:x1875407719771136:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528638.171749:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ec9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1823b577-e6d1-43c4-8232-3cf51fabc1da+14:2404:x1875407719771136:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 88us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528638.171757:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 184 00000100:00100000:0.0:1788528638.171806:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719771264 00000100:00100000:0.0:1788528638.171826:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719771264 00000100:00100000:0.0:1788528638.172070:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719771392 00000100:00100000:0.0:1788528638.172074:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719771392 00000100:00100000:0.0:1788528638.172099:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 72 00000100:00100000:0.0:1788528638.172106:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+13:2404:x1875407719771264:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528638.172143:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+13:2404:x1875407719771264:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 38us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528638.172150:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 72 00000100:00100000:0.0:1788528638.172163:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 73 00000100:00100000:0.0:1788528638.172169:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+5:2404:x1875407719771392:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528638.172365:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+5:2404:x1875407719771392:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 195us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528638.172373:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 73 00000100:00080000:0.0:1788528638.172640:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788528638.172645:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788528638.176106:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528638.176159:0:19172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719771520 00000100:00100000:0.0:1788528638.176171:0:19172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719771520 00000100:00100000:0.0:1788528638.176255:0:19172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 30 00000100:00100000:0.0:1788528638.176267:0:19172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd1383c0-cb68-4d87-bd29-af707cf13abe+5:2402:x1875407719771520:12345-192.168.203.38@tcp:9:kworker.0 00000020:00000080:0.0:1788528638.176304:0:19172:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c9065 00000100:00080000:0.0:1788528638.176323:0:19172:0:(import.c:65:import_set_state_nolock()) ffff8a8fc25a9000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788528638.176382:0:19172:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1788528638.176594:0:19172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd1383c0-cb68-4d87-bd29-af707cf13abe+2:2402:x1875407719771520:12345-192.168.203.38@tcp:9:kworker.0 Request processed in 328us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528638.176602:0:19172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 30 00000100:00080000:0.0:1788528638.176635:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788528638.176679:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528638.190034:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528638.190077:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528638.190101:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528638.190120:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528638.190213:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528638.190262:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719771648 00000100:00100000:2.0:1788528638.190273:0:18646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719771648 00000100:00100000:2.0:1788528638.190341:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719772032 00000100:00100000:2.0:1788528638.190345:0:18646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719772032 00000100:00100000:2.0:1788528638.190361:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719772160 00000100:00100000:2.0:1788528638.190364:0:18646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719772160 00000100:00100000:2.0:1788528638.190383:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 32 00000100:00100000:2.0:1788528638.190394:0:18646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd1383c0-cb68-4d87-bd29-af707cf13abe+5:2403:x1875407719771648:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528638.190481:0:18646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd1383c0-cb68-4d87-bd29-af707cf13abe+5:2403:x1875407719771648:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 89us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528638.190490:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 32 00000100:00100000:2.0:1788528638.190513:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 31 00000100:00100000:2.0:1788528638.190537:0:18646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dc02331c-9cea-4afd-8708-cba407bdbca8+5:2402:x1875407719772032:12345-192.168.203.38@tcp:9:kworker.0 00000020:00000080:2.0:1788528638.190584:0:18646:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c90ab 00000100:00080000:2.0:1788528638.190598:0:18646:0:(import.c:65:import_set_state_nolock()) ffff8a90ff70f800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788528638.190652:0:18646:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1788528638.190797:0:18646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dc02331c-9cea-4afd-8708-cba407bdbca8+2:2402:x1875407719772032:12345-192.168.203.38@tcp:9:kworker.0 Request processed in 262us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528638.190805:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 31 00000100:00100000:2.0:1788528638.190819:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 32 00000100:00100000:2.0:1788528638.190826:0:18646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dc02331c-9cea-4afd-8708-cba407bdbca8+5:2402:x1875407719772160:12345-192.168.203.38@tcp:9:kworker.0 00000020:00000080:2.0:1788528638.190846:0:18646:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c90b2 00000100:00080000:2.0:1788528638.190854:0:18646:0:(import.c:65:import_set_state_nolock()) ffff8a90ff70b000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788528638.190879:0:18646:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1788528638.190961:0:18646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dc02331c-9cea-4afd-8708-cba407bdbca8+2:2402:x1875407719772160:12345-192.168.203.38@tcp:9:kworker.0 Request processed in 136us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528638.190968:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 32 00000100:00100000:2.0:1788528638.190994:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719771776 00000100:00100000:2.0:1788528638.190999:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719771776 00000100:00100000:2.0:1788528638.191032:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719771904 00000100:00100000:2.0:1788528638.191036:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719771904 00000100:00100000:2.0:1788528638.191060:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 74 00000100:00100000:2.0:1788528638.191066:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dc02331c-9cea-4afd-8708-cba407bdbca8+6:2403:x1875407719771776:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528638.191095:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dc02331c-9cea-4afd-8708-cba407bdbca8+6:2403:x1875407719771776:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 29us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528638.191101:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 74 00000100:00100000:2.0:1788528638.191112:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 75 00000100:00100000:2.0:1788528638.191118:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dc02331c-9cea-4afd-8708-cba407bdbca8+5:2403:x1875407719771904:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528638.191152:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dc02331c-9cea-4afd-8708-cba407bdbca8+5:2403:x1875407719771904:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 34us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528638.191158:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 75 00010000:00010000:2.0:1788528638.191222:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528638.191229:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788528638.191250:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788528638.191255:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788528638.191258:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788528638.191260:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788528638.906133:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528638.906314:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719772288 00000100:00100000:2.0:1788528638.906323:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719772288 00000100:00100000:2.0:1788528638.906388:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 65 00000100:00100000:2.0:1788528638.906399:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+13:15582:x1875407719772288:12345-192.168.203.38@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788528638.906508:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+13:15582:x1875407719772288:12345-192.168.203.38@tcp:60:lhsmtool_posix.0 Request processed in 110us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528638.906516:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 65 00010000:00010000:0.0:1788528638.912214:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528638.915861:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528638.915974:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719772416 00000100:00100000:0.0:1788528638.915984:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719772416 00000100:00100000:0.0:1788528638.916044:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 66 00000100:00100000:0.0:1788528638.916055:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1383c0-cb68-4d87-bd29-af707cf13abe+5:15582:x1875407719772416:12345-192.168.203.38@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788528638.916156:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1383c0-cb68-4d87-bd29-af707cf13abe+5:15582:x1875407719772416:12345-192.168.203.38@tcp:60:lhsmtool_posix.0 Request processed in 102us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528638.916163:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 66 00000100:00100000:1.0:1788528638.939001:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528638.939595:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719772672 00000100:00100000:2.0:1788528638.939605:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719772672 00000100:00100000:2.0:1788528638.939664:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12 00000100:00100000:2.0:1788528638.939674:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+13:15582:x1875407719772672:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788528638.939916:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+14:15582:x1875407719772672:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 Request processed in 242us (922us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1788528638.939926:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12 00010000:00010000:2.0:1788528639.934985:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528640.192125:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735575168:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788528640.192264:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528640.192585:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735575168 00000100:00100000:2.0:1788528640.192606:0:18647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735575168 00000100:00100000:2.0:1788528640.192668:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788528640.192678:0:18647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735575168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788528640.192707:0:18647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528640.192762:0:18647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735575168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528640.192770:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788528640.193037:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788528640.193077:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735575168:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788528640.193095:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788528640.193101:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735575296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788528640.193127:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528640.194669:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735575296 00000100:00100000:2.0:1788528640.194684:0:18647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735575296 00000100:00100000:2.0:1788528640.194776:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788528640.194785:0:18647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735575296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788528640.194807:0:18647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528640.194891:0:18647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735575296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (1763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528640.194898:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788528640.195076:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735575296:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788528640.196525:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788528640.703158:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788528640.703182:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735575424:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788528640.703249:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528640.704307:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735575424 00000100:00100000:2.0:1788528640.704319:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735575424 00000100:00100000:2.0:1788528640.704382:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788528640.704391:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735575424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788528640.704426:0:17143:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1788528640.704495:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735575424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (1246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528640.704503:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788528640.704667:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735575424:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788528640.958981:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528641.215820:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788528641.215855:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6da0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735575552:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788528641.215926:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528641.216004:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788528641.216022:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735575680:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788528641.216065:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528641.218704:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:463b8984-c30b-4b73-b2f1-81113bd4e10a:3638:1875407735575808:0@lo:400:kworker.0 00000100:00100000:0.0:1788528641.218862:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735576064:0@lo:400:kworker.0 00000100:00100000:2.0:1788528641.218971:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735575552 00000100:00100000:2.0:1788528641.218979:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735575552 00000100:00100000:2.0:1788528641.219039:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788528641.219048:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735575552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788528641.219113:0:17143:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788528641.219239:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875407735576192:0@lo:400:kworker.0 00000100:00100000:0.0:1788528641.220361:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528641.220407:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735576576:0@lo:400:kworker.0 00000100:00100000:0.0:1788528641.220435:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528641.220479:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1875407735577088:0@lo:400:kworker.0 00000100:00100000:0.0:1788528641.220505:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528641.220532:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788528641.220539:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735575936:0@lo:400:kworker.0 00000100:00100000:0.0:1788528641.220579:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528641.220598:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735576448:0@lo:400:kworker.0 00000100:00100000:0.0:1788528641.220619:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528641.220637:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1875407735576960:0@lo:400:kworker.0 00000100:00100000:0.0:1788528641.220670:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528641.220707:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735576576 00000100:00100000:0.0:1788528641.220714:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735576576 00000100:00100000:0.0:1788528641.220771:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735577088 00000100:00100000:0.0:1788528641.220776:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735577088 00000100:00100000:0.0:1788528641.220799:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735576960 00000100:00100000:0.0:1788528641.220802:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735576960 00000100:00100000:0.0:1788528641.220819:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788528641.220826:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735576576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528641.220876:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735576576:12345-0@lo:400:kworker.0 Request processed in 51us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528641.220883:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788528641.220899:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788528641.220905:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875407735577088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528641.220932:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875407735577088:12345-0@lo:400:kworker.0 Request processed in 28us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528641.221074:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788528641.221288:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788528641.221297:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875407735576960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528641.221338:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875407735576960:12345-0@lo:400:kworker.0 Request processed in 43us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528641.221344:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788528641.221370:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735576064 00000100:00100000:0.0:1788528641.221374:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735576064 00000100:00100000:0.0:1788528641.221400:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735575936 00000100:00100000:0.0:1788528641.221403:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735575936 00000100:00100000:0.0:1788528641.221414:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735576448 00000100:00100000:0.0:1788528641.221416:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735576448 00000100:00100000:0.0:1788528641.221427:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788528641.221433:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735576064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528641.221465:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735576064:12345-0@lo:400:kworker.0 Request processed in 32us (1108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528641.221471:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788528641.221482:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788528641.221488:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735575936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528641.221514:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735575936:12345-0@lo:400:kworker.0 Request processed in 27us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528641.221519:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788528641.221527:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788528641.221532:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735576448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528641.221583:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735576448:12345-0@lo:400:kworker.0 Request processed in 51us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528641.221589:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1788528641.221625:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788528641.221629:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788528641.221631:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788528641.221669:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735575936:0@lo:400:kworker.0 00000100:00100000:0.0:1788528641.221681:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735576448:0@lo:400:kworker.0 00000100:00100000:0.0:1788528641.221690:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1875407735576960:0@lo:400:kworker.0 00000100:00100000:0.0:1788528641.221699:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735576064:0@lo:400:kworker.0 00000100:00100000:0.0:1788528641.221708:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735576576:0@lo:400:kworker.0 00010000:00080000:0.0:1788528641.221719:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc37ae300 x1875407735577088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528641.221730:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1875407735577088:0@lo:400:kworker.0 00000100:00100000:0.0:1788528641.221803:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735575680 00000100:00100000:0.0:1788528641.221807:0:18647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735575680 00000100:00100000:0.0:1788528641.221840:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788528641.221846:0:18647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735575680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788528641.221867:0:18647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915845632 avail 3684323328 00000100:00100000:0.0:1788528641.221899:0:18647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735575680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (5834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528641.221905:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788528641.221918:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788528641.222469:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735575552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3420us (6540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528641.222478:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788528641.223486:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6da0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735575552:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788528641.223884:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528641.223972:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528641.224026:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735576320:0@lo:400:kworker.0 00000100:00100000:1.0:1788528641.224058:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528641.224077:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1875407735576832:0@lo:400:kworker.0 00000100:00100000:3.0:1788528641.224401:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1875407735576704:0@lo:400:kworker.0 00000100:00100000:3.0:1788528641.224428:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528641.224469:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735575808 00000100:00100000:1.0:1788528641.224477:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735575808 00000100:00100000:1.0:1788528641.224518:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788528641.224526:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+27:3638:x1875407735575808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528641.224595:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+27:3638:x1875407735575808:12345-0@lo:400:kworker.0 Request processed in 69us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528641.224601:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788528641.224632:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735576320 00000100:00100000:1.0:1788528641.224635:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735576320 00000100:00100000:1.0:1788528641.224655:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788528641.224661:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735576320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528641.224703:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735576320:12345-0@lo:400:kworker.0 Request processed in 42us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528641.224708:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788528641.225690:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528641.225869:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719772800 00000100:00100000:1.0:1788528641.225877:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719772800 00000100:00100000:1.0:1788528641.225924:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 186 00000100:00100000:1.0:1788528641.225933:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1823b577-e6d1-43c4-8232-3cf51fabc1da+14:2406:x1875407719772800:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528641.225997:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1823b577-e6d1-43c4-8232-3cf51fabc1da+14:2406:x1875407719772800:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 66us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528641.226369:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 186 00000100:00100000:3.0:1788528641.227587:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735577216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788528641.227643:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528641.227700:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735577216 00000100:00100000:3.0:1788528641.227707:0:18647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735577216 00000100:00100000:3.0:1788528641.227759:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788528641.227907:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528641.227990:0:18647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735577216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788528641.228669:0:18647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915845632 avail 3684323328 00000100:00100000:3.0:1788528641.228756:0:18647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735577216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 769us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528641.228773:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788528641.228836:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735577216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788528641.230525:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735576192 00000100:00100000:0.0:1788528641.230541:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735576192 00000100:00100000:0.0:1788528641.230638:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735576704 00000100:00100000:0.0:1788528641.230642:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735576704 00000100:00100000:0.0:1788528641.230679:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788528641.230690:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875407735576192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528641.230890:0:19473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788528641.230901:0:19473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875407735576704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528641.232315:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719773056 00000100:00100000:2.0:1788528641.232326:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719773056 00000100:00100000:2.0:1788528641.232378:0:17138:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788528641.232388:0:17138:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1788528641.232619:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 81 00000100:00100000:2.0:1788528641.232628:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+5:2406:x1875407719773056:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528641.233853:0:19473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875407735576704:12345-0@lo:400:kworker.0 Request processed in 2949us (9417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528641.233864:0:19473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788528641.234375:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1875407735576704:0@lo:400:kworker.0 00000100:00100000:0.0:1788528641.234476:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875407735576192:12345-0@lo:400:kworker.0 Request processed in 3786us (10591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528641.234485:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:0.0:1788528641.234513:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788528641.234520:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788528641.234543:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875407735576192:0@lo:400:kworker.0 00000100:00100000:1.0:1788528641.234737:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528641.234790:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+5:2406:x1875407719773056:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 2161us (6882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528641.234798:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 81 00000100:00100000:2.0:1788528641.235152:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719773312 00000100:00100000:2.0:1788528641.235160:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719773312 00000100:00100000:1.0:1788528641.235330:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00080000:3.0:1788528641.235363:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788528641.238712:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528641.238756:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528641.239751:0:19473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719772928 00000100:00100000:0.0:1788528641.239772:0:19473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719772928 00000100:00100000:0.0:1788528641.239839:0:19473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 82 00000100:00100000:0.0:1788528641.239849:0:19473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dc02331c-9cea-4afd-8708-cba407bdbca8+6:2406:x1875407719773312:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528641.239935:0:19473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dc02331c-9cea-4afd-8708-cba407bdbca8+6:2406:x1875407719773312:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 87us (5199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528641.239955:0:19473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 82 00000100:00100000:0.0:1788528641.239976:0:19473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 83 00000100:00100000:0.0:1788528641.239982:0:19473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd1383c0-cb68-4d87-bd29-af707cf13abe+14:2406:x1875407719772928:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528641.240463:0:19473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd1383c0-cb68-4d87-bd29-af707cf13abe+14:2406:x1875407719772928:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 479us (5452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528641.240480:0:19473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 83 00000100:00080000:0.0:1788528641.240507:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788528641.240692:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719773184 00000100:00100000:0.0:1788528641.240698:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719773184 00000100:00100000:0.0:1788528641.240735:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 36 00000100:00100000:0.0:1788528641.240753:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+5:2406:x1875407719773184:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528641.241635:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+5:2406:x1875407719773184:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 889us (2930us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528641.241663:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 36 00000100:00080000:0.0:1788528641.241731:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788528641.245685:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528641.248098:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735575680:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788528641.248230:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:463b8984-c30b-4b73-b2f1-81113bd4e10a:3638:1875407735575808:0@lo:400:kworker.0 00000100:00100000:3.0:1788528641.248243:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735576320:0@lo:400:kworker.0 00000100:00100000:0.0:1788528641.249842:0:19473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719773440 00000100:00100000:0.0:1788528641.249856:0:19473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719773440 00000100:00100000:0.0:1788528641.249963:0:19473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735576832 00000100:00100000:0.0:1788528641.249967:0:19473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735576832 00000100:00100000:0.0:1788528641.249998:0:19473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 84 00000100:00100000:0.0:1788528641.250015:0:19473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dc02331c-9cea-4afd-8708-cba407bdbca8+5:2406:x1875407719773440:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528641.250114:0:19473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dc02331c-9cea-4afd-8708-cba407bdbca8+5:2406:x1875407719773440:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 107us (11356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528641.250133:0:19473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 84 00000100:00100000:0.0:1788528641.250152:0:19473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788528641.250158:0:19473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875407735576832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528641.250210:0:19473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875407735576832:12345-0@lo:400:kworker.0 Request processed in 52us (4533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528641.250216:0:19473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1788528641.250377:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788528641.250411:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc37ad880 x1875407735576832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528641.250424:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1875407735576832:0@lo:400:kworker.0 00000040:00080000:0.0:1788528641.598930:0:17173:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788528641.599260:0:17173:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788528641.599290:0:17173:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788528641.599298:0:17173:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788528641.982925:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788528642.753451:0:17117:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:0.0:1788528642.753471:0:17117:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967530 batchid updated 00000020:00080000:1.0:1788528642.753584:0:17177:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000020:00080000:1.0:1788528642.753599:0:17177:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00010000:00010000:0.0:1788528643.012881:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528643.270806:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528643.270847:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528643.270869:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528643.270886:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528643.270906:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528643.270930:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528643.270961:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719773568 00000100:00100000:1.0:1788528643.270973:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719773568 00000100:00100000:1.0:1788528643.271049:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 187 00000100:00100000:1.0:1788528643.271061:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1823b577-e6d1-43c4-8232-3cf51fabc1da+14:2406:x1875407719773568:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528643.271144:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1823b577-e6d1-43c4-8232-3cf51fabc1da+14:2406:x1875407719773568:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 85us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528643.271153:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 187 00000100:00100000:1.0:1788528643.271192:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719773824 00000100:00100000:1.0:1788528643.271196:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719773824 00000100:00100000:1.0:1788528643.271607:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719774080 00000100:00100000:1.0:1788528643.271625:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719774080 00000100:00100000:1.0:1788528643.271670:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719773696 00000100:00100000:1.0:1788528643.271674:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719773696 00000100:00100000:1.0:1788528643.271709:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719774208 00000100:00100000:1.0:1788528643.271713:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719774208 00000100:00100000:1.0:1788528643.271745:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 86 00000100:00100000:1.0:1788528643.271756:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+5:2406:x1875407719773824:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528643.272251:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+5:2406:x1875407719773824:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 495us (1401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528643.272261:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 86 00000100:00100000:1.0:1788528643.272284:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 87 00000100:00100000:1.0:1788528643.272291:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dc02331c-9cea-4afd-8708-cba407bdbca8+6:2406:x1875407719774080:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528643.272321:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dc02331c-9cea-4afd-8708-cba407bdbca8+6:2406:x1875407719774080:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 30us (1451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528643.272327:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 87 00000100:00100000:1.0:1788528643.272340:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 88 00000100:00100000:1.0:1788528643.272346:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+13:2406:x1875407719773696:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528643.272370:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+13:2406:x1875407719773696:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 24us (1483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528643.272376:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 88 00000100:00100000:1.0:1788528643.272388:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 89 00000100:00100000:1.0:1788528643.272394:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dc02331c-9cea-4afd-8708-cba407bdbca8+5:2406:x1875407719774208:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528643.272417:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dc02331c-9cea-4afd-8708-cba407bdbca8+5:2406:x1875407719774208:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 23us (1486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528643.272422:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 89 00000100:00080000:1.0:1788528643.272630:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788528643.272635:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788528643.272712:0:19172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719773952 00000100:00100000:1.0:1788528643.272719:0:19172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719773952 00000100:00100000:1.0:1788528643.272840:0:19172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 37 00000100:00100000:1.0:1788528643.272850:0:19172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd1383c0-cb68-4d87-bd29-af707cf13abe+5:2406:x1875407719773952:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528643.272895:0:19172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd1383c0-cb68-4d87-bd29-af707cf13abe+5:2406:x1875407719773952:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 45us (1985us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528643.272902:0:19172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 37 00000100:00080000:1.0:1788528643.272918:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:2.0:1788528643.615303:0:20515:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 09:30:42 (1788528642) 00000001:00100000:0.0:1788528643.779384:0:18640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dc02331c-9cea-4afd-8708-cba407bdbca8 00000020:00000080:0.0:1788528643.779392:0:18640:0:(genops.c:885:class_export_put()) final put ffff8a90ff70a800/dc02331c-9cea-4afd-8708-cba407bdbca8 00000001:00100000:0.0:1788528643.779419:0:18640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bd1383c0-cb68-4d87-bd29-af707cf13abe 00000020:00000080:0.0:1788528643.779433:0:18640:0:(genops.c:885:class_export_put()) final put ffff8a8fc25ab800/bd1383c0-cb68-4d87-bd29-af707cf13abe 00000020:00000080:1.0:1788528643.782854:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90ff70a800/dc02331c-9cea-4afd-8708-cba407bdbca8 for lustre-OST0000 00000020:00000080:1.0:1788528643.782915:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc25ab800/bd1383c0-cb68-4d87-bd29-af707cf13abe for lustre-OST0000 00000020:00000080:1.0:1788528643.782931:0:469:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a90ff70f800 for lustre-OST0000 00000020:00000080:1.0:1788528643.782935:0:469:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a8fc25a9000 for lustre-OST0000 00000001:00100000:1.0:1788528643.784124:0:19458:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dc02331c-9cea-4afd-8708-cba407bdbca8 00000020:00000080:1.0:1788528643.784132:0:19458:0:(genops.c:885:class_export_put()) final put ffff8a90ff708000/dc02331c-9cea-4afd-8708-cba407bdbca8 00000020:00000080:0.0:1788528643.784309:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90ff708000/dc02331c-9cea-4afd-8708-cba407bdbca8 for lustre-OST0001 00000020:00000080:0.0:1788528643.784348:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a90ff70b000 for lustre-OST0001 00010000:00010000:2.0:1788528644.030801:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528645.054898:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528645.313882:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788528645.313903:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735577344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788528645.313967:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528645.314161:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735577344 00000100:00100000:3.0:1788528645.314169:0:18647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735577344 00000100:00100000:3.0:1788528645.314232:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788528645.314242:0:18647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735577344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788528645.314271:0:18647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788528645.314327:0:18647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735577344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528645.314335:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788528645.314384:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735577344:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788528645.314534:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788528645.314545:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735577472:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788528645.314612:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528645.314640:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735577472 00000100:00100000:2.0:1788528645.314644:0:18647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735577472 00000100:00100000:2.0:1788528645.314670:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788528645.314677:0:18647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735577472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788528645.314688:0:18647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528645.314727:0:18647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735577472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528645.314741:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788528645.314774:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735577472:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788528645.315005:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788528645.823361:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735577600:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788528645.823470:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528645.823691:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735577600 00000100:00100000:2.0:1788528645.823698:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735577600 00000100:00100000:2.0:1788528645.823766:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788528645.823776:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735577600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788528645.823813:0:17142:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1788528645.823867:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735577600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528645.823874:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788528645.824349:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735577600:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1788528646.015234:0:17889:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788528646.078763:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528646.335064:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735577984:0@lo:400:kworker.0 00000100:00100000:1.0:1788528646.335132:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528646.335190:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fb0a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735578496:0@lo:400:kworker.0 00000100:00100000:1.0:1788528646.335212:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528646.335233:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fb0a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1875407735579008:0@lo:400:kworker.0 00000100:00100000:1.0:1788528646.335262:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528646.335301:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788528646.335313:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735578112:0@lo:400:kworker.0 00000100:00100000:1.0:1788528646.335335:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528646.335393:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fb0a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875407735578624:0@lo:400:kworker.0 00000100:00100000:1.0:1788528646.335415:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528646.335430:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fb0aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1875407735579136:0@lo:400:kworker.0 00000100:00100000:1.0:1788528646.335449:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528646.335476:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735579008 00000100:00100000:1.0:1788528646.335482:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735579008 00000100:00100000:1.0:1788528646.335527:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735578624 00000100:00100000:1.0:1788528646.335530:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735578624 00000100:00100000:1.0:1788528646.335545:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735579136 00000100:00100000:1.0:1788528646.335547:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735579136 00000100:00100000:1.0:1788528646.335588:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788528646.335597:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fb0ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875407735579008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528646.335648:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fb0ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875407735579008:12345-0@lo:400:kworker.0 Request processed in 51us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528646.335655:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788528646.335671:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788528646.335678:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fb0ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875407735578624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528646.335716:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fb0ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875407735578624:12345-0@lo:400:kworker.0 Request processed in 26us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528646.335722:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788528646.335735:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788528646.335741:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fb0abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875407735579136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528646.335768:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fb0abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875407735579136:12345-0@lo:400:kworker.0 Request processed in 27us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528646.335774:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788528646.335800:0:19172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735577984 00000100:00100000:1.0:1788528646.335803:0:19172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735577984 00000100:00100000:1.0:1788528646.335826:0:19172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735578496 00000100:00100000:1.0:1788528646.335828:0:19172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735578496 00000100:00100000:1.0:1788528646.335841:0:19172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735578112 00000100:00100000:1.0:1788528646.335844:0:19172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735578112 00000100:00100000:1.0:1788528646.335857:0:19172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788528646.335863:0:19172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fb0ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735577984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528646.335894:0:19172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fb0ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735577984:12345-0@lo:400:kworker.0 Request processed in 32us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528646.335900:0:19172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788528646.335910:0:19172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788528646.335916:0:19172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fb0a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735578496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528646.335956:0:19172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fb0a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735578496:12345-0@lo:400:kworker.0 Request processed in 40us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528646.335963:0:19172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788528646.335974:0:19172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788528646.335980:0:19172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fb0a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735578112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528646.336004:0:19172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fb0a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735578112:12345-0@lo:400:kworker.0 Request processed in 24us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528646.336010:0:19172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1788528646.336036:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788528646.336040:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788528646.336043:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788528646.336067:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735578112:0@lo:400:kworker.0 00000100:00100000:1.0:1788528646.336077:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fb0a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875407735578624:0@lo:400:kworker.0 00010000:00080000:1.0:1788528646.336087:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90fb0aa680 x1875407735579136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528646.336103:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fb0aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1875407735579136:0@lo:400:kworker.0 00000100:00100000:1.0:1788528646.336115:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735577984:0@lo:400:kworker.0 00000100:00100000:1.0:1788528646.336123:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fb0a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735578496:0@lo:400:kworker.0 00000100:00100000:1.0:1788528646.336130:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fb0a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1875407735579008:0@lo:400:kworker.0 00000100:00100000:0.0:1788528646.336237:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:463b8984-c30b-4b73-b2f1-81113bd4e10a:3637:1875407735577728:0@lo:400:kworker.0 00000100:00100000:0.0:1788528646.336273:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528646.336305:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875407735578240:0@lo:400:kworker.0 00000100:00100000:0.0:1788528646.336328:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528646.336346:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fb0aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1875407735578752:0@lo:400:kworker.0 00000100:00100000:0.0:1788528646.336366:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528646.336385:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788528646.336391:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735577856:0@lo:400:kworker.0 00000100:00100000:0.0:1788528646.336433:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528646.336452:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735578368:0@lo:400:kworker.0 00000100:00100000:0.0:1788528646.336472:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528646.336489:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fb0aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1875407735578880:0@lo:400:kworker.0 00000100:00100000:0.0:1788528646.336508:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528646.336544:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735578368 00000100:00100000:0.0:1788528646.336548:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735578368 00000100:00100000:0.0:1788528646.336593:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788528646.336599:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735578368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528646.336638:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735578368:12345-0@lo:400:kworker.0 Request processed in 39us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528646.336645:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788528646.336664:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735578240 00000100:00100000:0.0:1788528646.336668:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735578240 00000100:00100000:0.0:1788528646.336686:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735578752 00000100:00100000:0.0:1788528646.336689:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735578752 00000100:00100000:0.0:1788528646.336719:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735578880 00000100:00100000:0.0:1788528646.336722:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735578880 00000100:00100000:0.0:1788528646.336738:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788528646.336743:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875407735578240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528646.336774:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875407735578240:12345-0@lo:400:kworker.0 Request processed in 30us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528646.336779:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788528646.336790:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788528646.336796:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875407735578752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528646.336821:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875407735578752:12345-0@lo:400:kworker.0 Request processed in 26us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528646.336826:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788528646.336837:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788528646.336843:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875407735578880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528646.336868:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875407735578880:12345-0@lo:400:kworker.0 Request processed in 26us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528646.336873:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788528646.336892:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735577856 00000100:00100000:0.0:1788528646.336896:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735577856 00000100:00100000:0.0:1788528646.336920:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788528646.336933:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc374e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735577856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528646.336964:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc374e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735577856:12345-0@lo:400:kworker.0 Request processed in 33us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528646.336970:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788528646.337005:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735577856:0@lo:400:kworker.0 00000100:00100000:0.0:1788528646.337016:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735578368:0@lo:400:kworker.0 00010000:00080000:0.0:1788528646.337025:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90fb0aad80 x1875407735578880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528646.337035:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fb0aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1875407735578880:0@lo:400:kworker.0 00000100:00100000:0.0:1788528646.337044:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875407735578240:0@lo:400:kworker.0 00000100:00100000:0.0:1788528646.337053:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fb0aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1875407735578752:0@lo:400:kworker.0 00000100:00100000:1.0:1788528646.337873:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735577728 00000100:00100000:1.0:1788528646.337881:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735577728 00000100:00100000:1.0:1788528646.337916:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788528646.337922:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+27:3637:x1875407735577728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528646.337970:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:463b8984-c30b-4b73-b2f1-81113bd4e10a+27:3637:x1875407735577728:12345-0@lo:400:kworker.0 Request processed in 48us (1696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528646.337976:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00080000:1.0:1788528646.338009:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788528646.338013:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788528646.338029:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735579392:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788528646.338032:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735579520:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788528646.338058:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528646.338077:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735579520 00000100:00100000:3.0:1788528646.338081:0:18647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735579520 00000100:00100000:3.0:1788528646.338110:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788528646.338117:0:18647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fb0a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735579520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788528646.338138:0:18647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915845632 avail 3684323328 00000100:00100000:0.0:1788528646.338174:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735579264:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788528646.338179:0:18647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fb0a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735579520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528646.338185:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788528646.338201:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528646.338203:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528646.338224:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735579392 00000100:00100000:0.0:1788528646.338226:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:463b8984-c30b-4b73-b2f1-81113bd4e10a:3637:1875407735577728:0@lo:400:kworker.0 00000100:00100000:3.0:1788528646.338227:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735579392 00000100:00100000:3.0:1788528646.338245:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788528646.338250:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735579392:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788528646.338253:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735579264 00000100:00100000:0.0:1788528646.338256:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735579264 00002000:00000024:3.0:1788528646.338260:0:18648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915845632 avail 3684323328 00000100:00100000:0.0:1788528646.338276:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788528646.338287:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735579392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (83us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528646.338293:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788528646.338296:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735579264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788528646.338316:0:17142:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788528646.338318:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735579392:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788528646.338350:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735579264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528646.338368:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788528646.338396:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735579264:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788528646.339027:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735579520:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788528647.102724:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528647.358823:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528647.358929:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719774464 00000100:00100000:2.0:1788528647.358939:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719774464 00000100:00100000:2.0:1788528647.359026:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 13 00000100:00100000:2.0:1788528647.359039:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fb0a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+13:16344:x1875407719774464:12345-192.168.203.38@tcp:35:umount.0 00000001:00080000:2.0:1788528647.359277:0:17140:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:2.0:1788528647.359364:0:17140:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:2.0:1788528647.359495:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fb0a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+16:16344:x1875407719774464:12345-192.168.203.38@tcp:35:umount.0 Request processed in 459us (682us total) trans 8589934626 rc 0/0 00000100:00100000:2.0:1788528647.359504:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 13 00000020:00080000:2.0:1788528647.359509:0:17140:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00080000:1.0:1788528647.359941:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788528647.368706:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528647.368761:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528647.368791:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528647.368851:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528647.369002:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719774592 00000100:00100000:1.0:1788528647.369017:0:17123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719774592 00000100:00100000:1.0:1788528647.369073:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719774976 00000100:00100000:1.0:1788528647.369076:0:17123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719774976 00000100:00100000:1.0:1788528647.369088:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719774848 00000100:00100000:1.0:1788528647.369090:0:17123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719774848 00000100:00100000:3.0:1788528647.369130:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719774720 00000100:00100000:3.0:1788528647.369141:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719774720 00000100:00100000:1.0:1788528647.369141:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 3 00000100:00100000:1.0:1788528647.369163:0:17123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1823b577-e6d1-43c4-8232-3cf51fabc1da+17:2406:x1875407719774592:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788528647.369181:0:17123:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528647.369203:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c13fc400/0x892c60dda91c9042 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0073 expref: 17 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528647.369221:0:17123:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528647.369295:0:17123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1823b577-e6d1-43c4-8232-3cf51fabc1da+16:2406:x1875407719774592:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 139us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528647.369302:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 3 00000100:00100000:1.0:1788528647.369322:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 4 00000100:00100000:1.0:1788528647.369329:0:17123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6dd3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1823b577-e6d1-43c4-8232-3cf51fabc1da+15:2404:x1875407719774976:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788528647.369337:0:17123:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528647.369348:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9101851400/0x892c60dda91c90d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0161 expref: 15 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528647.369356:0:17123:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528647.369374:0:17123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6dd3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1823b577-e6d1-43c4-8232-3cf51fabc1da+14:2404:x1875407719774976:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 46us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528647.369380:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 4 00000100:00100000:1.0:1788528647.369431:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:1.0:1788528647.369440:0:17123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1823b577-e6d1-43c4-8232-3cf51fabc1da+13:2406:x1875407719774848:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788528647.369447:0:17123:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528647.369455:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a8fc3428200/0x892c60dda91c903b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c006c expref: 13 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528647.369476:0:17123:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528647.369617:0:17122:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788528647.369627:0:17122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788528647.370284:0:17123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1823b577-e6d1-43c4-8232-3cf51fabc1da+12:2406:x1875407719774848:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 843us (1489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528647.370293:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:1.0:1788528647.370312:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:1.0:1788528647.370320:0:17123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1823b577-e6d1-43c4-8232-3cf51fabc1da+11:2406:x1875407719774720:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788528647.370329:0:17123:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528647.370341:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c13fde00/0x892c60dda91c9049 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c00a4 expref: 11 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528647.370353:0:17123:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528647.372352:0:17123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1823b577-e6d1-43c4-8232-3cf51fabc1da+10:2406:x1875407719774720:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 2024us (3491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528647.372364:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:0.0:1788528647.372757:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528647.374301:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719775104 00000100:00100000:1.0:1788528647.374317:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719775104 00000100:00100000:1.0:1788528647.374440:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 33 00000100:00100000:1.0:1788528647.374451:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+5:2402:x1875407719775104:12345-192.168.203.38@tcp:9:umount.0 00000020:00000080:1.0:1788528647.374487:0:18643:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c906c 00000100:00080000:1.0:1788528647.374497:0:18643:0:(import.c:65:import_set_state_nolock()) ffff8a8fc25af000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788528647.374546:0:18643:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00010000:00010000:3.0:1788528647.374623:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528647.376315:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+2:2402:x1875407719775104:12345-192.168.203.38@tcp:9:umount.0 Request processed in 1857us (3549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528647.376328:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 33 00000100:00080000:2.0:1788528647.376615:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788528647.393890:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528647.394006:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719776000 00000100:00100000:1.0:1788528647.394031:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719776000 00000100:00100000:1.0:1788528647.394095:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 67 00000100:00100000:1.0:1788528647.394105:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+16:2402:x1875407719776000:12345-192.168.203.38@tcp:39:umount.0 00000020:00000080:1.0:1788528647.394137:0:17138:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c9057 00000020:00010000:1.0:1788528647.394156:0:17138:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a90c498c000: total 0 00000100:00080000:1.0:1788528647.394160:0:17138:0:(import.c:65:import_set_state_nolock()) ffff8a90f5a91000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788528647.394196:0:17138:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:1.0:1788528647.394350:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1383c0-cb68-4d87-bd29-af707cf13abe+15:2402:x1875407719776000:12345-192.168.203.38@tcp:39:umount.0 Request processed in 247us (470us total) trans 8589934627 rc 0/0 00000100:00100000:1.0:1788528647.394358:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 67 00000020:00010000:2.0:1788528647.394453:0:17125:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a90c498c000: total 0 00010000:00010000:2.0:1788528647.394457:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528647.394514:0:17125:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a90c498c000, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1788528647.394550:0:17125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a90c87be800) 00010000:00010000:2.0:1788528647.394588:0:17125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788528647.394597:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9101851800/0x892c60dda91c9129 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0168 expref: 14 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528647.394656:0:17125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a8fc27f0200) 00010000:00010000:2.0:1788528647.394659:0:17125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788528647.394663:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14ab000/0x892c60dda91c9209 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01a7 expref: 13 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528647.394679:0:17125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a90c87bef00) 00010000:00010000:2.0:1788528647.394681:0:17125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788528647.394685:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2a00/0x892c60dda91c92b8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01e6 expref: 12 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528647.394694:0:17125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a90c87bef00) 00010000:00010000:2.0:1788528647.394696:0:17125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788528647.394711:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e3000/0x892c60dda91c936e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c021e expref: 11 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528647.394726:0:17125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a8fc27f0d00) 00010000:00010000:2.0:1788528647.394728:0:17125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528647.394732:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a8fc26e2400/0x892c60dda91c9145 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c016f expref: 10 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528647.394744:0:17125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a90c87bef00) 00010000:00010000:2.0:1788528647.394753:0:17125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788528647.394758:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c6c82400/0x892c60dda91c9287 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01d1 expref: 9 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528647.394773:0:17125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a90c82d0900) 00010000:00010000:2.0:1788528647.394776:0:17125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788528647.394779:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14aa000/0x892c60dda91c9184 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c017d expref: 8 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528647.394790:0:17125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a90c87be400) 00010000:00010000:2.0:1788528647.394792:0:17125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788528647.394794:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031a00/0x892c60dda91c9313 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c01fb expref: 7 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528647.394805:0:17125:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a90c498c000, canceled 8 locks, left on hash table 0. 00010000:00010000:2.0:1788528647.394818:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528647.394819:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528647.394821:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528647.406842:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528647.407122:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719776128 00000100:00100000:0.0:1788528647.407134:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719776128 00000100:00100000:0.0:1788528647.407214:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 68 00000100:00100000:0.0:1788528647.407227:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+5:2402:x1875407719776128:12345-192.168.203.38@tcp:39:umount.0 00000020:00000080:0.0:1788528647.407261:0:17137:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c905e 00000100:00080000:0.0:1788528647.407279:0:17137:0:(import.c:65:import_set_state_nolock()) ffff8a90f5a92800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788528647.407310:0:17137:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:3.0:1788528647.407427:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788528647.407617:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788528647.408708:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1383c0-cb68-4d87-bd29-af707cf13abe+3:2402:x1875407719776128:12345-192.168.203.38@tcp:39:umount.0 Request processed in 1469us (1869us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788528647.408722:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 68 00010000:00010000:3.0:1788528648.129547:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528648.391355:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528648.392029:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528648.392315:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719776256 00000100:00100000:1.0:1788528648.392327:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719776256 00000100:00100000:1.0:1788528648.392389:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 189 00000100:00100000:1.0:1788528648.392399:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1823b577-e6d1-43c4-8232-3cf51fabc1da+10:2403:x1875407719776256:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528648.392475:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1823b577-e6d1-43c4-8232-3cf51fabc1da+10:2403:x1875407719776256:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 77us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528648.392482:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 189 00000100:00100000:3.0:1788528648.394990:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528648.400616:0:19473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719776384 00000100:00100000:2.0:1788528648.400631:0:19473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719776384 00000100:00080000:3.0:1788528648.400768:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788528648.401336:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719776512 00000100:00100000:1.0:1788528648.401342:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719776512 00000100:00100000:1.0:1788528648.401424:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 96 00000100:00100000:1.0:1788528648.401434:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dc02331c-9cea-4afd-8708-cba407bdbca8+6:2403:x1875407719776384:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528648.401515:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dc02331c-9cea-4afd-8708-cba407bdbca8+6:2403:x1875407719776384:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 83us (9488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528648.401522:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 96 00000100:00100000:1.0:1788528648.401539:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 97 00000100:00100000:1.0:1788528648.401544:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dc02331c-9cea-4afd-8708-cba407bdbca8+5:2404:x1875407719776512:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528648.401593:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dc02331c-9cea-4afd-8708-cba407bdbca8+5:2404:x1875407719776512:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 48us (6612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528648.401600:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 97 00000100:00080000:3.0:1788528648.402169:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788528649.150753:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528649.342184:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528649.342243:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528649.342280:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528649.342384:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528649.342630:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719776640 00000100:00100000:2.0:1788528649.342647:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719776640 00000100:00100000:2.0:1788528649.342739:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719776768 00000100:00100000:2.0:1788528649.342743:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719776768 00000100:00100000:2.0:1788528649.342760:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719776896 00000100:00100000:2.0:1788528649.342763:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719776896 00000100:00100000:2.0:1788528649.342774:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719777024 00000100:00100000:2.0:1788528649.342777:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719777024 00000100:00100000:2.0:1788528649.342829:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:2.0:1788528649.342842:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1823b577-e6d1-43c4-8232-3cf51fabc1da+13:2405:x1875407719776640:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788528649.342864:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528649.342891:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c0031200/0x892c60dda91c9088 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c00ea expref: 13 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528649.342914:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528649.342994:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1823b577-e6d1-43c4-8232-3cf51fabc1da+12:2405:x1875407719776640:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 154us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528649.343002:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:2.0:1788528649.343024:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 8 00000100:00100000:2.0:1788528649.343031:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1823b577-e6d1-43c4-8232-3cf51fabc1da+11:2405:x1875407719776768:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788528649.343040:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528649.343050:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c0031e00/0x892c60dda91c908f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c011b expref: 11 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528649.343061:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528649.343081:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1823b577-e6d1-43c4-8232-3cf51fabc1da+10:2405:x1875407719776768:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 51us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528649.343087:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 8 00000100:00100000:2.0:1788528649.343101:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:2.0:1788528649.343108:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1823b577-e6d1-43c4-8232-3cf51fabc1da+9:2403:x1875407719776896:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788528649.343115:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528649.343125:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a8fc3428600/0x892c60dda91c9081 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c00e3 expref: 9 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528649.343145:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528649.343164:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1823b577-e6d1-43c4-8232-3cf51fabc1da+8:2403:x1875407719776896:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 57us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528649.343172:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:2.0:1788528649.343187:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:2.0:1788528649.343193:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1823b577-e6d1-43c4-8232-3cf51fabc1da+7:2406:x1875407719777024:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788528649.343202:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528649.343211:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c6c82200/0x892c60dda91c90ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c015a expref: 7 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528649.343220:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528649.343238:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1823b577-e6d1-43c4-8232-3cf51fabc1da+6:2406:x1875407719777024:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 45us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528649.343244:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:1.0:1788528649.349313:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528649.349420:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719777280 00000100:00100000:0.0:1788528649.349434:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719777280 00000100:00100000:0.0:1788528649.349602:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 69 00000100:00100000:0.0:1788528649.349616:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fb0aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dc02331c-9cea-4afd-8708-cba407bdbca8+6:2402:x1875407719777280:12345-192.168.203.38@tcp:39:umount.0 00000020:00000080:0.0:1788528649.349673:0:17137:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c909d 00000020:00010000:0.0:1788528649.349696:0:17137:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a8fc3d29800: total 0 00000100:00080000:0.0:1788528649.349703:0:17137:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3d2c000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788528649.349742:0:17137:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00100000:0.0:1788528649.349943:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fb0aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dc02331c-9cea-4afd-8708-cba407bdbca8+5:2402:x1875407719777280:12345-192.168.203.38@tcp:39:umount.0 Request processed in 329us (656us total) trans 8589934628 rc 0/0 00000100:00100000:0.0:1788528649.349953:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 69 00000020:00010000:3.0:1788528649.351847:0:19476:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a8fc3d29800: total 0 00010000:00010000:3.0:1788528649.351942:0:19476:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a8fc3d29800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788528649.351990:0:19476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a90c82d0900) 00010000:00010000:3.0:1788528649.351996:0:19476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788528649.352010:0:19476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c14ab400/0x892c60dda91c9192 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0184 expref: 4 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528649.352044:0:19476:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a8fc3d29800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788528649.352058:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528649.352060:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528649.352062:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528649.358765:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528649.358855:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719777408 00000100:00100000:1.0:1788528649.358867:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719777408 00000100:00100000:1.0:1788528649.359087:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 70 00000100:00100000:1.0:1788528649.359100:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dc02331c-9cea-4afd-8708-cba407bdbca8+5:2402:x1875407719777408:12345-192.168.203.38@tcp:39:umount.0 00000020:00000080:1.0:1788528649.359153:0:17139:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c90a4 00000100:00080000:1.0:1788528649.359167:0:17139:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3147800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788528649.359199:0:17139:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00010000:00010000:3.0:1788528649.359260:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528649.359470:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dc02331c-9cea-4afd-8708-cba407bdbca8+3:2402:x1875407719777408:12345-192.168.203.38@tcp:39:umount.0 Request processed in 371us (716us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788528649.359480:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 70 00000100:00100000:2.0:1788528649.392837:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528649.393022:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719777536 00000100:00100000:1.0:1788528649.393036:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719777536 00000100:00100000:1.0:1788528649.393113:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 190 00000100:00100000:1.0:1788528649.393126:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6da6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1823b577-e6d1-43c4-8232-3cf51fabc1da+6:2402:x1875407719777536:12345-192.168.203.38@tcp:251:umount.0 00000020:00000080:1.0:1788528649.393186:0:17130:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c9034 00000100:00080000:1.0:1788528649.393199:0:17130:0:(import.c:65:import_set_state_nolock()) ffff8a8fc25ae800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788528649.393259:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528649.393294:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6da6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1823b577-e6d1-43c4-8232-3cf51fabc1da+1:2402:x1875407719777536:12345-192.168.203.38@tcp:251:umount.0 Request processed in 170us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528649.393302:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 190 00000020:00000080:1.0:1788528649.393315:0:17130:0:(genops.c:885:class_export_put()) final put ffff8a8fc25ad800/1823b577-e6d1-43c4-8232-3cf51fabc1da 00000020:00000080:0.0:1788528649.393379:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc25ad800/1823b577-e6d1-43c4-8232-3cf51fabc1da for MGS 00000020:00000080:1.0:1788528649.396694:0:469:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a8fc25ae800 for MGS 00010000:00010000:3.0:1788528650.175852:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528650.430933:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735579648:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788528650.431058:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735579776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788528650.431099:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528650.431152:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735579648 00000100:00100000:2.0:1788528650.431163:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735579648 00000100:00100000:2.0:1788528650.431234:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788528650.431248:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735579648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788528650.431287:0:18648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528650.431352:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735579648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528650.431360:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1788528650.431414:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788528650.431428:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528650.431509:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735579776 00000100:00100000:2.0:1788528650.431514:0:18647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735579776 00000100:00100000:2.0:1788528650.431769:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788528650.431779:0:18647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735579776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788528650.431791:0:18647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788528650.431798:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735579648:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788528650.431830:0:18647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735579776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528650.431837:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1788528650.431909:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788528650.431941:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735579776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788528650.943389:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735579904:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788528650.943490:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528650.943684:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735579904 00000100:00100000:0.0:1788528650.944388:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735579904 00000100:00100000:0.0:1788528650.944475:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788528650.944486:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735579904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788528650.944534:0:17142:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1788528650.945919:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735579904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1428us (2422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528650.945934:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788528650.946149:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735579904:0@lo:41:osp-pre-0-1.0 00000020:01000004:0.0:1788528651.145121:0:20711:0:(tgt_mount.c:2269:server_umount_begin()) umount -f 00000020:01000004:0.0:1788528651.151728:0:20711:0:(tgt_mount.c:2125:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788528651.151809:0:20711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c1551a00/0x892c60dda91c8bcd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8bd4 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528651.151828:0:20711:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c1551a00/0x892c60dda91c8bcd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8bd4 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528651.151837:0:20711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c1551a00/0x892c60dda91c8bcd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c8bd4 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528651.151845:0:20711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8a90c1551a00/0x892c60dda91c8bcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c8bd4 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528651.151919:0:20711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788528651.151943:0:20711:0:(mgc_request.c:650:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788528651.151974:0:20711:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788528651.151980:0:20711:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788528651.151988:0:20711:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788528651.152022:0:20711:0:(import.c:65:import_set_state_nolock()) ffff8a90d0053800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788528651.152127:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875407735580032:0@lo:39:umount.0 00000100:00100000:1.0:1788528651.152225:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528651.152358:0:20478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735580032 00000100:00100000:0.0:1788528651.152367:0:20478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735580032 00000100:00100000:0.0:1788528651.152433:0:20478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788528651.152443:0:20478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fb0a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875407735580032:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788528651.152480:0:20478:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8bfe 00000100:00080000:0.0:1788528651.152491:0:20478:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1f91000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788528651.152691:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788528651.152701:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c1551a00/0x892c60dda91c8bcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c8bd4 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528651.152711:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c1551a00 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:3.0:1788528651.152716:0:17126:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c1551a00/0x892c60dda91c8bcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c8bd4 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528651.152727:0:17126:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c1551a00/0x892c60dda91c8bcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1008400000000 nid: local remote: 0x892c60dda91c8bd4 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788528651.152735:0:17126:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c1551a00/0x892c60dda91c8bcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1009400000000 nid: local remote: 0x892c60dda91c8bd4 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528651.152741:0:17126:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788528651.152744:0:17126:0:(mgc_request.c:1180:mgc_blocking_ast()) log lustre-client: stale lock, won't requeue 10000000:01000000:3.0:1788528651.152747:0:17126:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788528651.152801:0:17126:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90c1551a00/0x892c60dda91c8bcd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c8bd4 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528651.152809:0:17126:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788528651.152863:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:463b8984-c30b-4b73-b2f1-81113bd4e10a:3639:1875407735580160:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788528651.152909:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788528651.152962:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c1551a00/0x892c60dda91c8bcd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c8bd4 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528651.152969:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c1551a00/0x892c60dda91c8bcd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c8bd4 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528651.152983:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528651.152994:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528651.152997:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528651.153150:0:20478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fb0a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3636:x1875407735580032:12345-0@lo:39:umount.0 Request processed in 707us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528651.153158:0:20478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:0.0:1788528651.153170:0:20478:0:(genops.c:885:class_export_put()) final put ffff8a8fc1f92000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:1.0:1788528651.153235:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735580160 00000100:00100000:1.0:1788528651.153240:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735580160 00000100:00100000:1.0:1788528651.153287:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788528651.153294:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6dd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:463b8984-c30b-4b73-b2f1-81113bd4e10a+27:3639:x1875407735580160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788528651.153308:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528651.153326:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c1551e00/0x892c60dda91c8bd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x892c60dda91c8bcd expref: 27 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528651.153340:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528651.153370:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6dd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:463b8984-c30b-4b73-b2f1-81113bd4e10a+26:3639:x1875407735580160:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528651.153376:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788528651.153476:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90d0053800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788528651.153486:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875407735580032:0@lo:39:umount.0 00000100:00100000:1.0:1788528651.153514:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:463b8984-c30b-4b73-b2f1-81113bd4e10a:3639:1875407735580160:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788528651.153590:0:20711:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788528651.153594:0:20711:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788528651.153600:0:20711:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788528651.153929:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc1f92000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788528651.153995:0:469:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a8fc1f91000 for lustre-MDT0000 00010000:00010000:0.0:1788528651.154499:0:20711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0031600/0x892c60dda91c8b1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8b25 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528651.154512:0:20711:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0031600/0x892c60dda91c8b1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8b25 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528651.154519:0:20711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0031600/0x892c60dda91c8b1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c8b25 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528651.154526:0:20711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8a90c0031600/0x892c60dda91c8b1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c8b25 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528651.154705:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788528651.154713:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c0031600/0x892c60dda91c8b1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c8b25 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528651.154721:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031600 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:3.0:1788528651.154725:0:17125:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c0031600/0x892c60dda91c8b1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c8b25 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528651.154735:0:17125:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c0031600/0x892c60dda91c8b1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1008400000000 nid: local remote: 0x892c60dda91c8b25 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788528651.154743:0:17125:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c0031600/0x892c60dda91c8b1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1009400000000 nid: local remote: 0x892c60dda91c8b25 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528651.154749:0:17125:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788528651.154753:0:17125:0:(mgc_request.c:1187:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1788528651.154788:0:17125:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90c0031600/0x892c60dda91c8b1e lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c8b25 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528651.154796:0:17125:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788528651.154849:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:463b8984-c30b-4b73-b2f1-81113bd4e10a:3640:1875407735580288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788528651.154917:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788528651.154985:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c0031600/0x892c60dda91c8b1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c8b25 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528651.154995:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528651.154996:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528651.154998:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528651.155058:0:20711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788528651.155064:0:20711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c0031600/0x892c60dda91c8b1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c8b25 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528651.155081:0:20711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8f5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8f62 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528651.155088:0:20711:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8f5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8f62 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528651.155095:0:20711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8f5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c8f62 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528651.155100:0:20711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8f5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c8f62 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528651.155152:0:20625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735580288 00000100:00100000:1.0:1788528651.155159:0:20625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735580288 00000100:00100000:1.0:1788528651.155207:0:20625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788528651.155217:0:20625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fb0a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:463b8984-c30b-4b73-b2f1-81113bd4e10a+26:3640:x1875407735580288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788528651.155230:0:20625:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528651.155253:0:20625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a8fc3428c00/0x892c60dda91c8b25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x892c60dda91c8b1e expref: 26 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528651.155267:0:20625:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528651.155302:0:20625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fb0a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:463b8984-c30b-4b73-b2f1-81113bd4e10a+25:3640:x1875407735580288:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528651.155309:0:20625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788528651.155349:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:463b8984-c30b-4b73-b2f1-81113bd4e10a:3640:1875407735580288:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788528651.155395:0:19476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788528651.155401:0:19476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8f5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c8f62 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528651.155420:0:19476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0030600 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:3.0:1788528651.155423:0:19476:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8f5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c8f62 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528651.155431:0:19476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8f5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x892c60dda91c8f62 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788528651.155439:0:19476:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8f5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x892c60dda91c8f62 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528651.155445:0:19476:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788528651.155448:0:19476:0:(mgc_request.c:1187:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1788528651.155466:0:19476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8f5b lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c8f62 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528651.155473:0:19476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788528651.155515:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:463b8984-c30b-4b73-b2f1-81113bd4e10a:3637:1875407735580416:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788528651.155542:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788528651.155628:0:19476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8f5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c8f62 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528651.155638:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528651.155640:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528651.155642:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528651.155712:0:20711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788528651.155717:0:20711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c0030600/0x892c60dda91c8f5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c8f62 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528651.155728:0:20711:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788528651.155763:0:20711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83a00/0x892c60dda91c9106 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c910d expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528651.155771:0:20711:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83a00/0x892c60dda91c9106 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c910d expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528651.155777:0:20711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83a00/0x892c60dda91c9106 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c910d expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528651.155791:0:20711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83a00/0x892c60dda91c9106 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c910d expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528651.155802:0:20711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788528651.155809:0:20711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0030200/0x892c60dda91c8b10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8b17 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528651.155815:0:20711:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0030200/0x892c60dda91c8b10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8b17 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528651.155821:0:20711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0030200/0x892c60dda91c8b10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c8b17 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528651.155827:0:20711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8a90c0030200/0x892c60dda91c8b10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c8b17 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528651.155836:0:20711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788528651.155842:0:20711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429a00/0x892c60dda91c8b02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8b09 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528651.155849:0:20711:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429a00/0x892c60dda91c8b02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8b09 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528651.155855:0:20711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429a00/0x892c60dda91c8b02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c8b09 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528651.155863:0:20711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429a00/0x892c60dda91c8b02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c8b09 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528651.155880:0:20711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:0.0:1788528651.155883:0:20711:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1788528651.155901:0:20711:0:(mgc_request.c:650:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1788528651.155930:0:20711:0:(tgt_mount.c:2175:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788528651.155935:0:20711:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788528651.155940:0:20711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788528651.155946:0:20711:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:0.0:1788528651.155952:0:20711:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a90f8f4a000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788528651.155957:0:20711:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a8fc3024800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788528651.155962:0:20711:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a90c3a0a800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788528651.155967:0:20711:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a8fc3d0c000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788528651.155975:0:20711:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8a8fc3d29800 dc02331c-9cea-4afd-8708-cba407bdbca8 192.168.203.38@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:0.0:1788528651.155980:0:20711:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8a90c498c000 bd1383c0-cb68-4d87-bd29-af707cf13abe 192.168.203.38@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:0.0:1788528651.155986:0:20711:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8a90f6c48000) has exports, disconnecting them 00000020:00080000:0.0:1788528651.155990:0:20711:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a90f8f4a000), last request at 1788528646 00000020:00000080:0.0:1788528651.155997:0:20711:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8f2a 00000100:00080000:0.0:1788528651.156016:0:20711:0:(import.c:65:import_set_state_nolock()) ffff8a8fc25a8800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788528651.156077:0:20711:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a90f8f4a000): rc 0 00000020:00000080:0.0:1788528651.156080:0:20711:0:(genops.c:885:class_export_put()) final put ffff8a90f8f4a000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788528651.156090:0:20711:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a8fc3024800), last request at 1788528646 00000020:00000080:0.0:1788528651.156093:0:20711:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8db7 00000100:00080000:0.0:1788528651.156098:0:20711:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3026800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788528651.156105:0:20711:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a8fc3024800): rc 0 00000020:00000080:0.0:1788528651.156107:0:20711:0:(genops.c:885:class_export_put()) final put ffff8a8fc3024800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1788528651.156110:0:20711:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a90c3a0a800), last request at 1788528574 00000020:00000080:0.0:1788528651.156120:0:20711:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8cfa 00000100:00080000:0.0:1788528651.156123:0:20711:0:(import.c:65:import_set_state_nolock()) ffff8a90c3a09000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788528651.156130:0:20711:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a90c3a0a800): rc 0 00000020:00000080:0.0:1788528651.156132:0:20711:0:(genops.c:885:class_export_put()) final put ffff8a90c3a0a800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1788528651.156137:0:20711:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a8fc3d0c000), last request at 1788528574 00000020:00000080:0.0:1788528651.156140:0:20711:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8c9f 00000100:00080000:0.0:1788528651.156143:0:20711:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3d08000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788528651.156149:0:20711:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000020:00080000:0.0:1788528651.156231:0:20711:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a8fc3d0c000): rc 0 00000004:00000080:0.0:1788528651.156239:0:20711:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff9b7a07b13ae0 00000100:00080000:0.0:1788528651.156261:0:20711:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788528651.156265:0:20711:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788528651.157141:0:20711:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788528651.157176:0:20711:0:(import.c:65:import_set_state_nolock()) ffff8a90de3f0800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788528651.157410:0:19476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788528651.157420:0:19476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83a00/0x892c60dda91c9106 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c910d expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528651.157431:0:19476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c6c83a00 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:3.0:1788528651.157436:0:19476:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83a00/0x892c60dda91c9106 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c910d expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528651.157465:0:19476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83a00/0x892c60dda91c9106 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x892c60dda91c910d expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788528651.157473:0:19476:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83a00/0x892c60dda91c9106 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x892c60dda91c910d expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528651.157479:0:19476:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788528651.157482:0:19476:0:(mgc_request.c:1180:mgc_blocking_ast()) log params: stale lock, won't requeue 10000000:01000000:3.0:1788528651.157486:0:19476:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788528651.157544:0:19476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83a00/0x892c60dda91c9106 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c910d expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528651.157568:0:19476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:0.0:1788528651.160831:0:20711:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788528651.160840:0:20711:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:0.0:1788528651.160858:0:20711:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788528651.160920:0:20711:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788528651.160952:0:20711:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1d08800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788528651.160967:0:20711:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788528651.160969:0:20711:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:0.0:1788528651.160988:0:20711:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788528651.161045:0:20711:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788528651.161054:0:20711:0:(import.c:65:import_set_state_nolock()) ffff8a90de3f4000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788528651.161104:0:20711:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8a90f6c48000) has no exports 00000020:00000080:1.0:1788528651.161437:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90f8f4a000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788528651.161501:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc3024800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788528651.161526:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90c3a0a800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788528651.161585:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a8fc25a8800 for lustre-MDT0000 00000020:00000080:1.0:1788528651.161591:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a8fc3026800 for lustre-MDT0000 00000020:00000080:1.0:1788528651.161596:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a90c3a09000 for lustre-MDT0000 00000100:00100000:1.0:1788528651.161623:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735580416 00000100:00100000:1.0:1788528651.161634:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735580416 00000100:00100000:1.0:1788528651.161714:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788528651.161726:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fb0a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:463b8984-c30b-4b73-b2f1-81113bd4e10a+25:3637:x1875407735580416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788528651.161743:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528651.161767:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c13fce00/0x892c60dda91c8f62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x892c60dda91c8f5b expref: 25 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528651.161786:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528651.161874:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fb0a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:463b8984-c30b-4b73-b2f1-81113bd4e10a+24:3637:x1875407735580416:12345-0@lo:103:ldlm_bl.0 Request processed in 149us (6329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528651.161903:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788528651.161941:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735580544:0@lo:39:umount.0 00000100:00100000:1.0:1788528651.161988:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528651.162020:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735580800:0@lo:9:umount.0 00000100:00100000:1.0:1788528651.162044:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528651.162065:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735580928:0@lo:9:umount.0 00000100:00100000:1.0:1788528651.162088:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528651.162120:0:19172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735580800 00000100:00100000:1.0:1788528651.162125:0:19172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735580800 00000100:00100000:1.0:1788528651.162153:0:19172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735580928 00000100:00100000:1.0:1788528651.162155:0:19172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735580928 00000100:00100000:1.0:1788528651.162186:0:19172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788528651.162191:0:19172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fb0a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875407735580800:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788528651.162219:0:19172:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8dfd 00000100:00080000:1.0:1788528651.162228:0:19172:0:(import.c:65:import_set_state_nolock()) ffff8a90d00ca800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788528651.162272:0:19172:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1788528651.162432:0:19172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fb0a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3636:x1875407735580800:12345-0@lo:9:umount.0 Request processed in 241us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528651.162439:0:19172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788528651.162452:0:19172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788528651.162457:0:19172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fb0a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875407735580928:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788528651.162470:0:19172:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8f69 00000100:00080000:1.0:1788528651.162476:0:19172:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3d1f800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788528651.162493:0:19172:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1788528651.162584:0:19172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fb0a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3636:x1875407735580928:12345-0@lo:9:umount.0 Request processed in 126us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528651.162600:0:19172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1788528651.162653:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1d08800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788528651.162661:0:3636:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788528651.162663:0:3636:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788528651.162667:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735580800:0@lo:9:umount.0 00000100:00080000:1.0:1788528651.162691:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90de3f4000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788528651.162695:0:3636:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788528651.162697:0:3636:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788528651.162699:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735580928:0@lo:9:umount.0 00000100:00100000:1.0:1788528651.162731:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:463b8984-c30b-4b73-b2f1-81113bd4e10a:3637:1875407735580416:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788528651.162745:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788528651.162752:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:463b8984-c30b-4b73-b2f1-81113bd4e10a:3637:1875407735580672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788528651.162782:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528651.162806:0:20625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735580672 00000100:00100000:1.0:1788528651.162810:0:20625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735580672 00000100:00100000:1.0:1788528651.162841:0:20625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788528651.162847:0:20625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fb0a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:463b8984-c30b-4b73-b2f1-81113bd4e10a+24:3637:x1875407735580672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788528651.162856:0:20625:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528651.162872:0:20625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c14aa400/0x892c60dda91c910d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x892c60dda91c9106 expref: 24 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528651.162886:0:20625:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528651.162908:0:20625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fb0a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:463b8984-c30b-4b73-b2f1-81113bd4e10a+23:3637:x1875407735580672:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528651.162914:0:20625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788528651.162951:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:463b8984-c30b-4b73-b2f1-81113bd4e10a:3637:1875407735580672:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788528651.163543:0:19476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83a00/0x892c60dda91c9106 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c910d expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528651.163568:0:19476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83a00/0x892c60dda91c9106 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c910d expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788528651.163608:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788528651.163627:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788528651.163633:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c0030200/0x892c60dda91c8b10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c8b17 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528651.163641:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0030200 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:3.0:1788528651.163645:0:17125:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c0030200/0x892c60dda91c8b10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c8b17 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528651.163655:0:17125:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c0030200/0x892c60dda91c8b10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x892c60dda91c8b17 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788528651.163685:0:17125:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c0030200/0x892c60dda91c8b10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x892c60dda91c8b17 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528651.163691:0:17125:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788528651.163694:0:17125:0:(mgc_request.c:1180:mgc_blocking_ast()) log lustre-barrier: stale lock, won't requeue 10000000:01000000:3.0:1788528651.163698:0:17125:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788528651.163752:0:17125:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90c0030200/0x892c60dda91c8b10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c8b17 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528651.163759:0:17125:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788528651.163780:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c0030200/0x892c60dda91c8b10 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c8b17 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528651.163787:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c0030200/0x892c60dda91c8b10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c8b17 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528651.163797:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788528651.163802:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429a00/0x892c60dda91c8b02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c8b09 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528651.163807:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3429a00 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:3.0:1788528651.163810:0:17125:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429a00/0x892c60dda91c8b02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c8b09 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528651.163816:0:17125:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429a00/0x892c60dda91c8b02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1008400000000 nid: local remote: 0x892c60dda91c8b09 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788528651.163821:0:17125:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429a00/0x892c60dda91c8b02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1009400000000 nid: local remote: 0x892c60dda91c8b09 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528651.163836:0:17125:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788528651.163838:0:17125:0:(mgc_request.c:1180:mgc_blocking_ast()) log lustre-sptlrpc: stale lock, won't requeue 10000000:01000000:3.0:1788528651.163840:0:17125:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788528651.163876:0:17125:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429a00/0x892c60dda91c8b02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c8b09 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528651.163882:0:17125:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788528651.163888:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429a00/0x892c60dda91c8b02 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c8b09 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528651.163893:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735580544 00010000:00010000:3.0:1788528651.163894:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429a00/0x892c60dda91c8b02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5809400000020 nid: local remote: 0x892c60dda91c8b09 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528651.163899:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735580544 00010000:00010000:3.0:1788528651.163902:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528651.163904:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528651.163905:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528651.163912:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528651.163916:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528651.163918:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528651.163920:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528651.163945:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788528651.163954:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fb0aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875407735580544:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788528651.163986:0:17143:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8d24 00000100:00080000:2.0:1788528651.164070:0:17143:0:(import.c:65:import_set_state_nolock()) ffff8a90c7d54800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788528651.164098:0:17143:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1788528651.164253:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fb0aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3636:x1875407735580544:12345-0@lo:39:umount.0 Request processed in 300us (2264us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788528651.164315:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:0.0:1788528651.164626:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90de3f0800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788528651.164635:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735580544:0@lo:39:umount.0 00000100:00100000:1.0:1788528651.164839:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:463b8984-c30b-4b73-b2f1-81113bd4e10a:3640:1875407735581184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788528651.164892:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528651.164928:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788528651.164934:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:463b8984-c30b-4b73-b2f1-81113bd4e10a:3640:1875407735581056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788528651.164955:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528651.164979:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735581184 00000100:00100000:1.0:1788528651.164983:0:17123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735581184 00000100:00100000:1.0:1788528651.165017:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735581056 00000100:00100000:1.0:1788528651.165019:0:17123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735581056 00000100:00100000:1.0:1788528651.165035:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788528651.165041:0:17123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fb0aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:463b8984-c30b-4b73-b2f1-81113bd4e10a+24:3640:x1875407735581184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788528651.165054:0:17123:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528651.165073:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9101850c00/0x892c60dda91c8b09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x892c60dda91c8b02 expref: 24 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528651.165243:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528651.166549:0:17123:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528651.166643:0:17123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fb0aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:463b8984-c30b-4b73-b2f1-81113bd4e10a+23:3640:x1875407735581184:12345-0@lo:103:ldlm_bl.0 Request processed in 1597us (1747us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528651.166655:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788528651.166698:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788528651.166712:0:17123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fb0aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:463b8984-c30b-4b73-b2f1-81113bd4e10a+22:3640:x1875407735581056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788528651.166732:0:17123:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528651.166753:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a8fc3429000/0x892c60dda91c8b17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x892c60dda91c8b10 expref: 22 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528651.166763:0:17123:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528651.166787:0:17123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fb0aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:463b8984-c30b-4b73-b2f1-81113bd4e10a+21:3640:x1875407735581056:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (1831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528651.166806:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788528651.166869:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:463b8984-c30b-4b73-b2f1-81113bd4e10a:3640:1875407735581056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788528651.166879:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:463b8984-c30b-4b73-b2f1-81113bd4e10a:3640:1875407735581184:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1788528651.177102:0:20711:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8a90f6c48000) has no exports 00000020:00000080:2.0:1788528651.229319:0:20711:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8b6b 00000020:00000080:2.0:1788528651.229336:0:20711:0:(genops.c:885:class_export_put()) final put ffff8a90f58df000/lustre-QMT0000_UUID 00000020:01000000:2.0:1788528651.229409:0:20711:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788528651.229578:0:20711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788528651.229589:0:20711:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788528651.229593:0:20711:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8a8fc35e6600) has no exports 00000020:00000080:3.0:1788528651.230165:0:20711:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8b64 00000020:00000080:3.0:1788528651.230172:0:20711:0:(genops.c:885:class_export_put()) final put ffff8a90c7f8a800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788528651.230223:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90f58df000/lustre-QMT0000_UUID for lustre-QMT0000 00010000:00010000:1.0:1788528651.230264:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788528651.230375:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90c7f8a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788528651.230441:0:20711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788528651.230451:0:20711:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788528651.230454:0:20711:0:(genops.c:885:class_export_put()) final put ffff8a90c7f8d800/lustre-QMT0000_UUID 00000020:00000080:3.0:1788528651.230456:0:20711:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90c7f8d800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788528651.230472:0:20711:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00100000:3.0:1788528651.454876:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788528651.454897:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735581312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788528651.454969:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528651.454997:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735581312 00000100:00100000:2.0:1788528651.455006:0:18647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735581312 00000100:00100000:3.0:1788528651.455014:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735581440:0@lo:400:kworker.0 00000100:00100000:3.0:1788528651.455042:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528651.455060:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1875407735581952:0@lo:400:kworker.0 00000100:00100000:2.0:1788528651.455067:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788528651.455079:0:18647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735581312:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788528651.455106:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1788528651.455110:0:18647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915845632 avail 3684323328 00000100:00100000:3.0:1788528651.455133:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788528651.455141:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735581824:0@lo:400:kworker.0 00000100:00100000:2.0:1788528651.455160:0:18647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735581312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528651.455168:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735581952 00000100:00100000:3.0:1788528651.455175:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528651.455176:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735581952 00000100:00100000:0.0:1788528651.455220:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735581824 00000100:00100000:0.0:1788528651.455223:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735581824 00000100:00100000:2.0:1788528651.455306:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788528651.455329:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735581312:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788528651.455334:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788528651.455340:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788528651.455344:0:19172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735581440 00000100:00100000:1.0:1788528651.455350:0:19172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735581440 00000100:00100000:2.0:1788528651.455362:0:19473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788528651.455373:0:19473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875407735581952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528651.455387:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788528651.455391:0:19172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788528651.455398:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1875407735581824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528651.455405:0:19172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735581440:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788528651.455411:0:17139:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788528651.455420:0:19473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875407735581952:12345-0@lo:400:kworker.0 Request processed in 50us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528651.455428:0:19473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788528651.455460:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1875407735581824:12345-0@lo:400:kworker.0 Request processed in 62us (287us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788528651.455465:0:19172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735581440:12345-0@lo:400:kworker.0 Request processed in 63us (420us total) trans 0 rc 0/0 00000100:00080000:2.0:1788528651.455470:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:3.0:1788528651.455474:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1788528651.455480:0:3638:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3109000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:1.0:1788528651.455481:0:19172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:02000400:2.0:1788528651.455489:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1788528651.455504:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735581696:0@lo:400:kworker.0 00000100:00100000:3.0:1788528651.455534:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528651.455577:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1875407735582208:0@lo:400:kworker.0 00000100:00100000:3.0:1788528651.455597:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528651.455616:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788528651.455622:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735581568:0@lo:400:kworker.0 00000100:00100000:1.0:1788528651.455639:0:20478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735581696 00000100:00100000:3.0:1788528651.455644:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528651.455646:0:20478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735581696 00000100:00100000:1.0:1788528651.455680:0:20478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735582208 00000100:00100000:3.0:1788528651.455684:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1875407735582080:0@lo:400:kworker.0 00000100:00100000:1.0:1788528651.455685:0:20478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735582208 00000100:00100000:3.0:1788528651.455713:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528651.455720:0:20478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735582080 00000100:00100000:1.0:1788528651.455725:0:20478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735582080 00000100:00100000:3.0:1788528651.455739:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735581568 00000100:00100000:3.0:1788528651.455745:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735581568 00000100:00100000:1.0:1788528651.455746:0:20478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788528651.455757:0:20478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875407735582208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528651.455778:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788528651.455787:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735581568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528651.455806:0:20478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875407735582208:12345-0@lo:400:kworker.0 Request processed in 50us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528651.455814:0:20478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788528651.455826:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735581568:12345-0@lo:400:kworker.0 Request processed in 41us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528651.455833:0:20478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788528651.455838:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788528651.455844:0:20478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1875407735581696:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788528651.455850:0:20478:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788528651.455868:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788528651.455873:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875407735582080:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788528651.455879:0:17139:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788528651.455883:0:20478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1875407735581696:12345-0@lo:400:kworker.0 Request processed in 38us (345us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788528651.455898:0:20478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788528651.455913:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875407735582080:12345-0@lo:400:kworker.0 Request processed in 37us (197us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788528651.455920:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1788528651.455931:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788528651.455956:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735581568:0@lo:400:kworker.0 00000100:00080000:3.0:1788528651.455966:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788528651.455969:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3144000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788528651.455972:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788528651.455977:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3144000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788528651.455980:0:3640:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 474 00000100:00080000:3.0:1788528651.455986:0:3640:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a8fc3144000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1788528651.456009:0:3640:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90ffa4d500 x1875407735582336/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788528651.456038:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1875407735582080:0@lo:400:kworker.0 00000100:00080000:3.0:1788528651.456058:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788528651.456061:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8a90c5a9b000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788528651.456064:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788528651.456067:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8a90c5a9b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788528651.456070:0:3640:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 443 00000100:00080000:3.0:1788528651.456073:0:3640:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a90c5a9b000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1788528651.456112:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1875407735582336:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788528651.456144:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528651.456184:0:20478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735582336 00000100:00100000:1.0:1788528651.456188:0:20478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735582336 00000100:00100000:1.0:1788528651.456215:0:20478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788528651.456219:0:20478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3636:x1875407735582336:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1788528651.456243:0:20478:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788528651.457926:0:3640:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90fa8ac000 x1875407735582464/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788528651.458054:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735581696:0@lo:400:kworker.0 00010000:00080000:3.0:1788528651.458462:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90faa0aa00 x1875407735582208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528651.458475:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1875407735582208:0@lo:400:kworker.0 00000100:00100000:0.0:1788528651.458750:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875407735582464:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1788528651.458829:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528651.459114:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735582464 00000100:00100000:3.0:1788528651.459122:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735582464 00000100:00100000:0.0:1788528651.459594:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788528651.459606:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1875407735582464:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1788528651.459626:0:17137:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788528651.459698:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1875407735582464:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 94us (879us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788528651.459705:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1788528651.459794:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90c5a9b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788528651.459800:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788528651.459803:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875407735582464:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788528651.478115:0:20478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3636:x1875407735582336:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 21887us (21964us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788528651.478139:0:20478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1788528651.478323:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3144000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788528651.478330:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788528651.478334:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1875407735582336:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:2.0:1788528651.508468:0:3638:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3109000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788528651.508486:0:3638:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 459 00000100:00080000:2.0:1788528651.508500:0:3638:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a8fc3109000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1788528651.508743:0:3638:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90fa8ac000 x1875407735582592/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788528651.508785:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735581824:0@lo:400:kworker.0 00000100:00100000:3.0:1788528651.508832:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735581440:0@lo:400:kworker.0 00010000:00080000:3.0:1788528651.508846:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90faa09f80 x1875407735581952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528651.508854:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1875407735581952:0@lo:400:kworker.0 00000100:00100000:0.0:1788528651.509784:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1875407735582592:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788528651.509862:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528651.510863:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735582592 00000100:00100000:1.0:1788528651.510875:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735582592 00000100:00100000:1.0:1788528651.510931:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788528651.510939:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1875407735582592:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1788528651.510959:0:17138:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788528651.511028:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1875407735582592:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 89us (1165us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788528651.511036:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1788528651.511608:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3109000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788528651.511615:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788528651.511619:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1875407735582592:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:3.0:1788528652.291100:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788528652.992401:0:19458:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788528652.992409:0:19458:0:(genops.c:885:class_export_put()) final put ffff8a8fc3d19800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788528652.992421:0:19458:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bd1383c0-cb68-4d87-bd29-af707cf13abe 00000020:00000080:1.0:1788528652.992424:0:19458:0:(genops.c:885:class_export_put()) final put ffff8a8fc25a9800/bd1383c0-cb68-4d87-bd29-af707cf13abe 00000020:00000080:0.0:1788528652.994973:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc3d19800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788528652.995246:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc25a9800/bd1383c0-cb68-4d87-bd29-af707cf13abe for lustre-OST0001 00000020:00000080:0.0:1788528652.995274:0:469:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a8fc3d1f800 for lustre-OST0001 00000020:00000080:0.0:1788528652.995281:0:469:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a8fc25af000 for lustre-OST0001 00000001:00100000:1.0:1788528652.997149:0:17870:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788528652.997164:0:17870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:1.0:1788528652.997169:0:17870:0:(genops.c:885:class_export_put()) final put ffff8a90c7d50000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788528652.998915:0:17117:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788528652.998923:0:17117:0:(genops.c:885:class_export_put()) final put ffff8a8fc3d0c000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788528652.998945:0:17117:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of dc02331c-9cea-4afd-8708-cba407bdbca8 00000001:00080000:0.0:1788528652.998952:0:17117:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:0.0:1788528652.998955:0:17117:0:(genops.c:885:class_export_put()) final put ffff8a8fc3d29800/dc02331c-9cea-4afd-8708-cba407bdbca8 00000001:00100000:0.0:1788528652.998961:0:17117:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bd1383c0-cb68-4d87-bd29-af707cf13abe 00000001:00080000:0.0:1788528652.998966:0:17117:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:0.0:1788528652.998973:0:17117:0:(genops.c:885:class_export_put()) final put ffff8a90c498c000/bd1383c0-cb68-4d87-bd29-af707cf13abe 00000020:00000080:3.0:1788528652.999037:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc3d0c000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1788528652.999137:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc3d29800/dc02331c-9cea-4afd-8708-cba407bdbca8 for lustre-MDT0000 00000020:00000080:3.0:1788528652.999161:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90c498c000/bd1383c0-cb68-4d87-bd29-af707cf13abe for lustre-MDT0000 00000020:00000080:3.0:1788528652.999186:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a8fc3d08000 for lustre-MDT0000 00000020:00000080:3.0:1788528652.999191:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a8fc3d2c000 for lustre-MDT0000 00000020:00000080:3.0:1788528652.999194:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a90f5a91000 for lustre-MDT0000 00000001:00100000:1.0:1788528652.999445:0:17870:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of dc02331c-9cea-4afd-8708-cba407bdbca8 00000001:00080000:1.0:1788528652.999451:0:17870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:1.0:1788528652.999453:0:17870:0:(genops.c:885:class_export_put()) final put ffff8a8fc3142800/dc02331c-9cea-4afd-8708-cba407bdbca8 00000001:00100000:1.0:1788528652.999458:0:17870:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of bd1383c0-cb68-4d87-bd29-af707cf13abe 00000001:00080000:1.0:1788528652.999463:0:17870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:1.0:1788528652.999465:0:17870:0:(genops.c:885:class_export_put()) final put ffff8a90f5a91800/bd1383c0-cb68-4d87-bd29-af707cf13abe 00000020:00000080:3.0:1788528652.999517:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90c7d50000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1788528652.999548:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc3142800/dc02331c-9cea-4afd-8708-cba407bdbca8 for lustre-MDT0001 00000020:00000080:3.0:1788528652.999657:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90f5a91800/bd1383c0-cb68-4d87-bd29-af707cf13abe for lustre-MDT0001 00000020:00000080:3.0:1788528652.999688:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a90c7d54800 for lustre-MDT0001 00000020:00000080:3.0:1788528652.999692:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a8fc3147800 for lustre-MDT0001 00000020:00000080:3.0:1788528652.999696:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a90f5a92800 for lustre-MDT0001 00000020:01000000:3.0:1788528653.246700:0:20711:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a8fc241fd80 - data ffff8a90f0ec9870/ffff8a8fc3087000 00000020:01000000:3.0:1788528653.246879:0:20711:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a8fc1d590c0 - data ffff8a90d21920d8/ffff8a90f7df3000 00000001:00000004:3.0:1788528653.263851:0:20711:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00010000:00010000:3.0:1788528653.312591:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788528653.328233:0:20711:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788528653.328241:0:20711:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788528653.328254:0:20711:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8a8fc3eb0a80 x1875407735580544/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788528661 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528653.328276:0:20711:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788528653.330195:0:20711:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788528653.330202:0:20711:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:3.0:1788528653.330483:0:20711:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788528653.330487:0:20711:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788528653.334994:0:17161:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788528653.335002:0:17161:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1788528653.335014:0:17161:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1788528653.335707:0:20711:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788528653.335712:0:20711:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:3.0:1788528653.335728:0:20711:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788528653.335730:0:20711:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788528653.336328:0:17163:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788528653.336332:0:17163:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:0.0:1788528653.336369:0:17163:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1788528653.340834:0:20711:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8b33 00000020:00000080:3.0:1788528653.340846:0:20711:0:(genops.c:885:class_export_put()) final put ffff8a90d0054000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788528653.341756:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90d0054000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788528653.343816:0:20711:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8b48 00000020:00000080:3.0:1788528653.343828:0:20711:0:(genops.c:885:class_export_put()) final put ffff8a90de3f2000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788528653.343871:0:20711:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788528653.343883:0:20711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788528653.343891:0:20711:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788528653.343894:0:20711:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8a90f6c4cc80) has no exports 00000004:01000000:3.0:1788528653.344476:0:20711:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788528653.344485:0:20711:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8baa 00000020:00000080:3.0:1788528653.344490:0:20711:0:(genops.c:885:class_export_put()) final put ffff8a90efa8d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788528653.346250:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90de3f2000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788528653.346384:0:20711:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788528653.346393:0:20711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788528653.346404:0:20711:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788528653.346408:0:20711:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8a90f7de8000) has no exports 00000020:00000080:3.0:1788528653.346417:0:20711:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8ba3 00000020:00000080:3.0:1788528653.346425:0:20711:0:(genops.c:885:class_export_put()) final put ffff8a90de3f7800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788528653.346836:0:20711:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788528653.346841:0:20711:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788528653.346854:0:20711:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:3.0:1788528653.346860:0:20711:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788528653.346862:0:20711:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788528653.347121:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90efa8d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788528653.347130:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90de3f7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788528653.347136:0:469:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a90de3f4000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788528653.347288:0:20711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788528653.347296:0:20711:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788528653.347300:0:20711:0:(genops.c:885:class_export_put()) final put ffff8a8fc1d0b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788528653.347302:0:20711:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc1d0b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788528653.347308:0:20711:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788528653.347398:0:20711:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8b95 00000020:00000080:3.0:1788528653.347404:0:20711:0:(genops.c:885:class_export_put()) final put ffff8a8fc1d08000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788528653.347450:0:20711:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788528653.347454:0:20711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788528653.347459:0:20711:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788528653.347463:0:20711:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8a90f6c4b300) has no exports 00000020:00000080:3.0:1788528653.347467:0:20711:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8b8e 00000020:00000080:3.0:1788528653.347470:0:20711:0:(genops.c:885:class_export_put()) final put ffff8a8fc1d0a000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788528653.349955:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc1d08000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788528653.351474:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc1d0a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788528653.351930:0:20711:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788528653.351936:0:20711:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788528653.351940:0:20711:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:3.0:1788528653.352086:0:20711:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788528653.352089:0:20711:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788528653.352126:0:20711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788528653.352135:0:20711:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1788528653.352152:0:20711:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788528653.352160:0:20711:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8b80 00000020:00000080:3.0:1788528653.352170:0:20711:0:(genops.c:885:class_export_put()) final put ffff8a8fc1d0f000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788528653.352176:0:20711:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1788528653.352181:0:20711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788528653.352185:0:20711:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788528653.352189:0:20711:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff8a90f6c4e600) has no exports 00000020:00000080:3.0:1788528653.352197:0:20711:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8b79 00000020:00000080:3.0:1788528653.352201:0:20711:0:(genops.c:885:class_export_put()) final put ffff8a90de3f7000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788528653.354502:0:469:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a8fc1d08800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788528653.354518:0:469:0:(genops.c:885:class_export_put()) final put ffff8a8fc1d0e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788528653.354522:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc1d0e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788528653.354529:0:469:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788528653.354633:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc1d0f000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788528653.354638:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90de3f7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788528653.405778:0:20711:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788528653.405788:0:20711:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788528653.405792:0:20711:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788528653.405800:0:20711:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788528653.405854:0:20711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788528653.405868:0:20711:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788528653.405895:0:20711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788528653.405898:0:20711:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788528653.405904:0:20711:0:(genops.c:885:class_export_put()) final put ffff8a90d0055000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788528653.405908:0:20711:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90d0055000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788528653.405918:0:20711:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788528653.406045:0:20711:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8b4f 00000020:00000080:0.0:1788528653.406052:0:20711:0:(genops.c:885:class_export_put()) final put ffff8a90de3f5800/lustre-MDD0000_UUID 00000020:01000000:0.0:1788528653.406056:0:20711:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788528653.406060:0:20711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788528653.406065:0:20711:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788528653.406069:0:20711:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8a90f6c49980) has no exports 00000020:00000080:0.0:1788528653.406085:0:20711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788528653.406088:0:20711:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788528653.406091:0:20711:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8b56 00000020:00000080:0.0:1788528653.406095:0:20711:0:(genops.c:885:class_export_put()) final put ffff8a90de3f6000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788528653.406103:0:20711:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8a8fc477d800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788528653.406107:0:20711:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8a8fc477d800 3 00000020:01000004:0.0:1788528653.406109:0:20711:0:(tgt_mount.c:134:server_deregister_mount()) deregister mount ffff8a8fc477d800 from lustre-MDT0000 00000020:00000080:0.0:1788528653.406125:0:20711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788528653.406129:0:20711:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788528653.406145:0:20711:0:(genops.c:885:class_export_put()) final put ffff8a90d0051000/lustre-MDT0000_UUID 00000020:00000080:0.0:1788528653.406147:0:20711:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90d0051000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788528653.406153:0:20711:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788528653.406189:0:20711:0:(obd_mount.c:580:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788528653.406193:0:20711:0:(tgt_mount.c:284:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788528653.406196:0:20711:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788528653.406198:0:20711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788528653.406201:0:20711:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788528653.406207:0:20711:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8a8fc45c0800 463b8984-c30b-4b73-b2f1-81113bd4e10a 0@lo 20 (0 0 15) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788528653.406213:0:20711:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8a8fc35e3300) has exports, disconnecting them 00000020:00080000:0.0:1788528653.406217:0:20711:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8a8fc45c0800), last request at 1788528559 00000020:00000080:0.0:1788528653.406233:0:20711:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8afb 00000020:00010000:0.0:1788528653.406237:0:20711:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a8fc45c0800: total 2 00000100:00080000:0.0:1788528653.406242:0:20711:0:(import.c:65:import_set_state_nolock()) ffff8a8fc45c2000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788528653.406254:0:20711:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a8fc45c0800): rc 0 00000020:00080000:0.0:1788528653.406258:0:20711:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8a8fc35e3300) has no exports 00000100:00100000:0.0:1788528653.406333:0:17131:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8a90f6fa4800:17131] 1 exiting: rc = 0 00000020:00010000:1.0:1788528653.406588:0:17126:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a8fc45c0800: total 2 00010000:00010000:1.0:1788528653.406630:0:17126:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a8fc45c0800, canceled 0 locks, left on hash table 15. 00010000:00010000:1.0:1788528653.406668:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c784f200/0x892c60dda91c8eeb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x892c60dda91c8ee4 expref: 16 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528653.406686:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c13fc600/0x892c60dda91c8edd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x892c60dda91c8ed6 expref: 15 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528653.406711:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c0030800/0x892c60dda91c8d6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x892c60dda91c8d63 expref: 14 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528653.406721:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c1551800/0x892c60dda91c8d78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x892c60dda91c8d71 expref: 13 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528653.406732:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9101851600/0x892c60dda91c8c1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x892c60dda91c8c13 expref: 12 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528653.406742:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c14abe00/0x892c60dda91c90f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x892c60dda91c90ea expref: 11 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528653.406761:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a8fc3429400/0x892c60dda91c8c28 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x892c60dda91c8c21 expref: 10 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528653.406773:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c13fc200/0x892c60dda91c8f15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x892c60dda91c8f0e expref: 9 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528653.406781:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c13fd000/0x892c60dda91c8f54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x892c60dda91c8f4d expref: 8 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528653.406792:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a8fc3428a00/0x892c60dda91c8ce5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x892c60dda91c8cde expref: 7 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528653.406801:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c1551400/0x892c60dda91c8c36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x892c60dda91c8c2f expref: 6 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528653.406812:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9101851200/0x892c60dda91c90e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x892c60dda91c90dc expref: 5 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528653.406836:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a8fc26e3a00/0x892c60dda91c90ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x892c60dda91c90f8 expref: 4 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528653.406847:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c1550a00/0x892c60dda91c8da2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x892c60dda91c8d9b expref: 3 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528653.406858:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a8fc3429800/0x892c60dda91c8c44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x892c60dda91c8c3d expref: 2 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528653.406868:0:17126:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a8fc45c0800, canceled 15 locks, left on hash table 0. 00000020:00000080:1.0:1788528653.406882:0:17126:0:(genops.c:885:class_export_put()) final put ffff8a8fc45c0800/463b8984-c30b-4b73-b2f1-81113bd4e10a 00010000:00010000:1.0:1788528653.406888:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528653.406890:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528653.406892:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528653.406937:0:17130:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8a8fc275ca00:17130] 0 exiting: rc = 1 00000020:00000080:1.0:1788528653.406999:0:469:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a90de3f0800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788528653.407006:0:469:0:(genops.c:885:class_export_put()) final put ffff8a90de3f2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788528653.407008:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90de3f2800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788528653.407012:0:469:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788528653.407059:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90de3f5800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788528653.407063:0:469:0:(genops.c:885:class_export_put()) final put ffff8a90d0054800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788528653.407065:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90d0054800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788528653.407069:0:469:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788528653.407090:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90de3f6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788528653.407093:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc45c0800/463b8984-c30b-4b73-b2f1-81113bd4e10a for MGS 00000020:00000080:1.0:1788528653.407119:0:469:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a8fc45c2000 for MGS 00000100:00100000:2.0:1788528653.412451:0:17132:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8a90f6fa4e00:17132] 2 exiting: rc = 0 00000100:00100000:0.0:1788528653.413124:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413132:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413138:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413145:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413152:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413158:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413165:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413171:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413176:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413182:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413188:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413194:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413200:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413205:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413211:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413230:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413236:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413241:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413247:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413252:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413258:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413262:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413267:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413272:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413277:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413281:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413287:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413291:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413297:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413302:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413307:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413312:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413317:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413322:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413327:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413333:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413338:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413344:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413350:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413366:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413372:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413378:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413383:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413387:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413392:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413397:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413402:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413407:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413411:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413415:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413429:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413434:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413439:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413444:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413450:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413455:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413461:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413465:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413470:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413476:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413482:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413487:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413493:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528653.413498:0:20711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1788528653.414676:0:20711:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a90f8f387e0 - data ffff8a90f0da0288/ffff8a8fc308c800 00000020:01000000:0.0:1788528653.414797:0:20711:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a90c85c0300 - data ffff8a90f0c2fd80/ffff8a8fc3e2a400 00000020:00000080:0.0:1788528653.415218:0:20711:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8adf 00000020:00000080:0.0:1788528653.415227:0:20711:0:(genops.c:885:class_export_put()) final put ffff8a8fc44ce800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788528653.415279:0:20711:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8a8fc477d800 from MGS, refs=2 00000020:01000004:0.0:1788528653.415284:0:20711:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8a8fc477d800 2 00000020:01000004:0.0:1788528653.415286:0:20711:0:(tgt_mount.c:134:server_deregister_mount()) deregister mount ffff8a8fc477d800 from MGS 00000020:00000080:0.0:1788528653.415306:0:20711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788528653.415312:0:20711:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788528653.415315:0:20711:0:(genops.c:885:class_export_put()) final put ffff8a8fc44cc800/MGS 00000020:00000080:0.0:1788528653.415317:0:20711:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc44cc800/MGS for MGS 00000020:01000000:0.0:1788528653.415324:0:20711:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788528653.415400:0:20711:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788528653.415404:0:20711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788528653.415410:0:20711:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788528653.415415:0:20711:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8a8fc1d0c000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788528653.415421:0:20711:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff8a910195e600) has exports, disconnecting them 00000020:00080000:0.0:1788528653.415426:0:20711:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8a8fc1d0c000), last request at 1788528559 00000020:00000080:0.0:1788528653.415429:0:20711:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8be2 00000020:00080000:0.0:1788528653.415445:0:20711:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a8fc1d0c000): rc 0 00000020:00000080:0.0:1788528653.415449:0:20711:0:(genops.c:885:class_export_put()) final put ffff8a8fc1d0c000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788528653.415980:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc44ce800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788528653.416844:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc1d0c000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788528653.464769:0:20711:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788528653.464777:0:20711:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788528653.464782:0:20711:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788528653.464791:0:20711:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788528653.464822:0:469:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a90d0053800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788528653.464997:0:20711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788528653.465005:0:20711:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788528653.465010:0:20711:0:(genops.c:885:class_export_put()) final put ffff8a90efa8e800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788528653.465014:0:20711:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90efa8e800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788528653.465025:0:20711:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788528653.465103:0:20711:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8a8fc477d800 1 00000020:00000080:1.0:1788528653.465110:0:20711:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8ad1 00000020:00000080:1.0:1788528653.465128:0:20711:0:(genops.c:885:class_export_put()) final put ffff8a8fc44cd000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1788528653.465136:0:20711:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788528653.465144:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc44cd000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788528653.465153:0:20711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788528653.465158:0:20711:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788528653.465161:0:20711:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8a9101958000) has no exports 00000020:00000080:0.0:1788528653.535031:0:20711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788528653.535044:0:20711:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788528653.535050:0:20711:0:(genops.c:885:class_export_put()) final put ffff8a8fc477f800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788528653.535054:0:20711:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc477f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788528653.535066:0:20711:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788528653.535252:0:20711:0:(obd_mount.c:670:lustre_free_lsi()) Freeing lsi ffff8a8fc4778000 00000020:02000400:0.0:1788528653.535310:0:20711:0:(tgt_mount.c:2258:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788528654.340856:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788528655.296310:0:17134:0:(tgt_mount.c:234:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788528655.296326:0:17134:0:(tgt_mount.c:115:server_register_mount()) register mount ffff8a90c81b5800 from MGS 00000020:01000004:1.0:1788528655.296331:0:17134:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788528655.296348:0:17134:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8a90ce96e600) 00000020:00000080:1.0:1788528655.296367:0:17134:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type mgs with refcount 2 00000020:01000004:1.0:1788528655.296447:0:17134:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8a90c81b5800 from MGS, refs=3 00080000:01000000:1.0:1788528655.296456:0:17134:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788528655.296462:0:17134:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x892c60dda91c9391 00010000:00010000:1.0:1788528655.296669:0:17134:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:1.0:1788528655.296767:0:17134:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788528655.296943:0:17134:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788528655.302184:0:17134:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788528655.302350:0:17134:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788528655.302358:0:17134:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788528655.302733:0:17134:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788528655.302739:0:17134:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788528655.302830:0:17134:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788528655.302834:0:17134:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788528655.303239:0:17134:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00010000:00010000:3.0:1788528655.359718:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528655.555666:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735582720:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788528655.555740:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528655.556105:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735582720 00000100:00100000:1.0:1788528655.556113:0:18647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735582720 00000100:00100000:1.0:1788528655.556176:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788528655.556186:0:18647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3eb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735582720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788528655.556216:0:18647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788528655.556260:0:18647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3eb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735582720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528655.556267:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1788528655.556326:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788528655.556362:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735582720:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788528656.067996:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788528656.068017:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3eb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735582848:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788528656.068086:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528656.068142:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735582848 00000100:00100000:3.0:1788528656.068151:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735582848 00000100:00100000:3.0:1788528656.068199:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788528656.068207:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1875407735582848:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1788528656.068215:0:17142:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788528656.068256:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1875407735582848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 47us (169us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788528656.068262:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:02020000:0.0:1788528656.068379:0:3637:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:0.0:1788528656.081116:0:3637:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788528656.081123:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8a90c83a9800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788528656.081127:0:3637:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788528656.101298:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8a90c83a9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788528656.101311:0:3637:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 443 00000100:00080000:0.0:1788528656.101322:0:3637:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a90c83a9800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1788528656.101384:0:3637:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90fe690380 x1875407735582976/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788528656.101774:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735582976:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788528656.101844:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528656.104908:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735582976 00000100:00100000:0.0:1788528656.104935:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735582976 00000100:00100000:0.0:1788528656.105583:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788528656.105593:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1875407735582976:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1788528656.105619:0:17142:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788528656.138600:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1875407735582976:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 32997us (36745us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788528656.138614:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1788528656.138756:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90c83a9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788528656.138763:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788528656.138767:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735582976:0@lo:38:ptlrpcd_00_00.0 00000040:00080000:3.0:1788528656.255323:0:17889:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788528656.392808:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528656.579988:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735583104:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788528656.580066:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528656.580810:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735583104 00000100:00100000:1.0:1788528656.580819:0:18647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735583104 00000100:00100000:1.0:1788528656.580883:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788528656.580892:0:18647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735583104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788528656.580919:0:18647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915845632 avail 3684323328 00000100:00100000:1.0:1788528656.580963:0:18647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735583104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528656.580969:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1788528656.580989:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788528656.581116:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735583104:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788528656.581176:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:463b8984-c30b-4b73-b2f1-81113bd4e10a:3640:1875407735583232:0@lo:400:kworker.0 00000100:00100000:3.0:1788528656.581208:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788528656.581261:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788528656.581265:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788528656.581268:0:469:0:(import.c:65:import_set_state_nolock()) ffff8a90c5a9b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788528656.581273:0:469:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 520 00000100:00080000:3.0:1788528656.581278:0:469:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788528656.581282:0:469:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a90c5a9b000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1788528656.581293:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735583360:0@lo:400:kworker.0 00000100:00100000:3.0:1788528656.581319:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528656.581374:0:469:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90fa8adf80 x1875407735583488/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788528656.581389:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788528656.581392:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788528656.581394:0:469:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3109000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788528656.581398:0:469:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 520 00000100:00080000:3.0:1788528656.581401:0:469:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788528656.581404:0:469:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a8fc3109000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1788528656.581416:0:469:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90fa8aea00 x1875407735583616/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788528656.581435:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788528656.581439:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788528656.581440:0:469:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3144000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788528656.581444:0:469:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 520 00000100:00080000:3.0:1788528656.581446:0:469:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788528656.581449:0:469:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a8fc3144000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1788528656.581458:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1875407735583744:0@lo:400:kworker.0 00000100:00100000:3.0:1788528656.581487:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528656.581518:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735583744 00000100:00100000:3.0:1788528656.581522:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735583744 00000100:00100000:3.0:1788528656.581573:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788528656.581581:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875407735583744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528656.581617:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875407735583744:12345-0@lo:400:kworker.0 Request processed in 38us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528656.581623:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:3.0:1788528656.581673:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90fa8ac700 x1875407735583744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528656.581683:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1875407735583744:0@lo:400:kworker.0 00000100:00100000:3.0:1788528656.581711:0:469:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90fa8ac700 x1875407735583872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788528656.581739:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1875407735584000:0@lo:400:kworker.0 00000100:00100000:3.0:1788528656.581762:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528656.582115:0:20804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735583232 00000100:00100000:1.0:1788528656.582124:0:20804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735583232 00000100:00100000:1.0:1788528656.582192:0:20804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788528656.582197:0:20804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc308f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3640:x1875407735583232:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788528656.582203:0:20804:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788528656.582368:0:20804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc308f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3640:x1875407735583232:12345-0@lo:400:kworker.0 Request processed in 169us (1158us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788528656.582375:0:20804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788528656.582448:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.138@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788528656.582452:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8a90c5a9a000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788528656.582456:0:3640:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.138@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:1.0:1788528656.589934:0:19172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735583360 00000100:00100000:1.0:1788528656.589948:0:19172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735583360 00000100:00100000:1.0:1788528656.590005:0:19172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788528656.590015:0:19172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735583360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528656.590112:0:19172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735583360:12345-0@lo:400:kworker.0 Request processed in 99us (8792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528656.590119:0:19172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788528656.590149:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875407735583488:0@lo:38:kworker.0 00000100:00100000:1.0:1788528656.590186:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528656.590212:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1875407735583616:0@lo:38:kworker.0 00000100:00100000:1.0:1788528656.590232:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528656.590250:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1875407735583872:0@lo:38:kworker.0 00000100:00100000:1.0:1788528656.590270:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788528656.590297:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788528656.590309:0:20478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735584000 00000100:00100000:1.0:1788528656.590313:0:20478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735584000 00000100:00100000:1.0:1788528656.590343:0:20478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735583488 00000100:00100000:1.0:1788528656.590346:0:20478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735583488 00000100:00100000:1.0:1788528656.590355:0:20478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735583616 00000100:00100000:1.0:1788528656.590357:0:20478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735583616 00000100:00100000:1.0:1788528656.590364:0:20478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735583872 00000100:00100000:1.0:1788528656.590376:0:20478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735583872 00000100:00100000:1.0:1788528656.590391:0:20478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788528656.590397:0:20478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875407735584000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528656.590433:0:20478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875407735584000:12345-0@lo:400:kworker.0 Request processed in 36us (8669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528656.590440:0:20478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788528656.590450:0:20478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788528656.590454:0:20478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3636:x1875407735583488:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788528656.590473:0:20478:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788528656.590504:0:20478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3636:x1875407735583488:12345-0@lo:38:kworker.0 Request processed in 48us (317us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788528656.590511:0:20478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788528656.590521:0:20478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788528656.590525:0:20478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3636:x1875407735583616:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788528656.590533:0:20478:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788528656.590578:0:20478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3636:x1875407735583616:12345-0@lo:38:kworker.0 Request processed in 51us (345us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788528656.590584:0:20478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788528656.590595:0:20478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788528656.590599:0:20478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3636:x1875407735583872:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788528656.590608:0:20478:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788528656.590631:0:20478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3636:x1875407735583872:12345-0@lo:38:kworker.0 Request processed in 31us (361us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788528656.590648:0:20478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1788528656.590679:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788528656.590711:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90c5a9b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788528656.590716:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788528656.590720:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875407735583488:0@lo:38:kworker.0 00000100:00080000:1.0:1788528656.590728:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3109000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788528656.590731:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788528656.590733:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1875407735583616:0@lo:38:kworker.0 00000100:00080000:1.0:1788528656.590740:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3144000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788528656.590743:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788528656.590746:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1875407735583872:0@lo:38:kworker.0 00000100:00100000:1.0:1788528656.590785:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735583360:0@lo:400:kworker.0 00010000:00080000:1.0:1788528656.590814:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90fa8ac380 x1875407735584000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528656.590824:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1875407735584000:0@lo:400:kworker.0 00000100:00080000:3.0:1788528656.592810:0:3640:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.138@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788528656.592815:0:3640:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788528656.592825:0:3640:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a90fa8ae300 x1875407735583232/t0(0) o400->MGC192.168.203.138@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788528672 ref 1 fl Rpc:RNQU/200/0 rc 0/-107 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788528656.592839:0:3640:0:(mgc_request.c:1414:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788528656.592842:0:3640:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788528656.592843:0:3640:0:(mgc_request.c:1414:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788528656.592846:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8a90c5a9a000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788528656.592851:0:3640:0:(import.c:545:import_select_connection()) MGC192.168.203.138@tcp: connect to NID 0@lo last attempt 428 00000100:00080000:3.0:1788528656.592859:0:3640:0:(import.c:665:import_select_connection()) MGC192.168.203.138@tcp: import ffff8a90c5a9a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1788528656.592886:0:3640:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90fa8ad880 x1875407735584128/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788528656.592914:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:463b8984-c30b-4b73-b2f1-81113bd4e10a:3640:1875407735583232:0@lo:400:kworker.0 00000100:00100000:1.0:1788528656.593191:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:463b8984-c30b-4b73-b2f1-81113bd4e10a:3636:1875407735584128:0@lo:250:ptlrpcd_00_03.0 00000100:00100000:1.0:1788528656.593254:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:0.0:1788528656.594543:0:18640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788528656.594550:0:18640:0:(genops.c:885:class_export_put()) final put ffff8a90d00cb000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788528656.594596:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90d00cb000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788528656.594643:0:469:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a90d00ca800 for lustre-OST0000 00000100:00100000:3.0:1788528656.596000:0:20806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735584128 00000100:00100000:3.0:1788528656.596012:0:20806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735584128 00000100:00100000:3.0:1788528656.596062:0:20806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788528656.596078:0:20806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc308c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3636:x1875407735584128:12345-0@lo:250:ptlrpcd_00_03.0 00010000:00000400:3.0:1788528656.596097:0:20806:0:(ldlm_lib.c:1248:target_handle_connect()) MGS: refusing connection from 0@lo: this is an MGS follower, which only serves clients that support it: rc = -19 00000100:00100000:2.0:1788528656.627696:0:20806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc308c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3636:x1875407735584128:12345-0@lo:250:ptlrpcd_00_03.0 Request processed in 31613us (34437us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788528656.627714:0:20806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788528656.629732:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90c5a9a000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788528656.629744:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-19) 00000100:00100000:1.0:1788528656.629749:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:463b8984-c30b-4b73-b2f1-81113bd4e10a:3636:1875407735584128:0@lo:250:ptlrpcd_00_03.0 00000020:01000004:1.0:1788528657.241397:0:20916:0:(tgt_mount.c:2269:server_umount_begin()) umount -f 00000020:01000004:1.0:1788528657.262438:0:20916:0:(tgt_mount.c:2125:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1788528657.262498:0:20916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429c00/0x892c60dda91c8cde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8ce5 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528657.262513:0:20916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429c00/0x892c60dda91c8cde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8ce5 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528657.262533:0:20916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429c00/0x892c60dda91c8cde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c8ce5 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528657.262544:0:20916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429c00/0x892c60dda91c8cde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c8ce5 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528657.262577:0:20916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788528657.262639:0:19476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788528657.262647:0:19476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429c00/0x892c60dda91c8cde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c8ce5 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528657.262655:0:19476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3429c00 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:3.0:1788528657.262659:0:19476:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429c00/0x892c60dda91c8cde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c8ce5 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528657.262667:0:19476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429c00/0x892c60dda91c8cde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x892c60dda91c8ce5 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788528657.262675:0:19476:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429c00/0x892c60dda91c8cde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x892c60dda91c8ce5 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528657.262680:0:19476:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788528657.262682:0:19476:0:(mgc_request.c:1180:mgc_blocking_ast()) log lustre-client: stale lock, won't requeue 00010000:00010000:3.0:1788528657.262696:0:19476:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a90c5a9a000 00010000:00010000:3.0:1788528657.262699:0:19476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429c00/0x892c60dda91c8cde lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c8ce5 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528657.262705:0:19476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429c00/0x892c60dda91c8cde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c8ce5 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528657.262717:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528657.262719:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528657.262720:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788528657.263117:0:20916:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.203.138@tcp: clear lustre-client 10000000:01000000:2.0:1788528657.263122:0:20916:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 10000000:01000000:2.0:1788528657.263192:0:20916:0:(mgc_request.c:650:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788528657.263217:0:20916:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788528657.263221:0:20916:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788528657.263227:0:20916:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788528657.263232:0:20916:0:(import.c:65:import_set_state_nolock()) ffff8a90c5a9b000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788528657.263237:0:20916:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788528657.263245:0:20916:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788528657.263248:0:20916:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788528657.264484:0:20916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0031400/0x892c60dda91c8c3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8c44 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528657.264500:0:20916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0031400/0x892c60dda91c8c3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8c44 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528657.264507:0:20916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0031400/0x892c60dda91c8c3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c8c44 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528657.264514:0:20916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8a90c0031400/0x892c60dda91c8c3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c8c44 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528657.264628:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788528657.264644:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c0031400/0x892c60dda91c8c3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c8c44 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528657.264648:0:20916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788528657.264663:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031400 already unused, calling callback (ffffffffc11e0e00) 10000000:01000000:2.0:1788528657.264663:0:20916:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.203.138@tcp: clear lustre-MDT0001 10000000:00010000:3.0:1788528657.264666:0:17125:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c0031400/0x892c60dda91c8c3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c8c44 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528657.264668:0:20916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0030c00/0x892c60dda91c8f4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8f54 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528657.264676:0:17125:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c0031400/0x892c60dda91c8c3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x892c60dda91c8c44 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528657.264676:0:20916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0030c00/0x892c60dda91c8f4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8f54 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788528657.264684:0:17125:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c0031400/0x892c60dda91c8c3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x892c60dda91c8c44 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528657.264684:0:20916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0030c00/0x892c60dda91c8f4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c8f54 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528657.264690:0:17125:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788528657.264690:0:20916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8a90c0030c00/0x892c60dda91c8f4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c8f54 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528657.264692:0:17125:0:(mgc_request.c:1180:mgc_blocking_ast()) log lustre-MDT0001: stale lock, won't requeue 00010000:00010000:3.0:1788528657.264701:0:17125:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a90c5a9a000 00010000:00010000:2.0:1788528657.264703:0:20916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788528657.264704:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c0031400/0x892c60dda91c8c3d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c8c44 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528657.264708:0:20916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2200/0x892c60dda91c90f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c90ff expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528657.264710:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c0031400/0x892c60dda91c8c3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c8c44 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528657.264720:0:20916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2200/0x892c60dda91c90f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c90ff expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528657.264722:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788528657.264725:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c0030c00/0x892c60dda91c8f4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c8f54 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528657.264726:0:20916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2200/0x892c60dda91c90f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c90ff expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528657.264732:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0030c00 already unused, calling callback (ffffffffc11e0e00) 00010000:00010000:2.0:1788528657.264734:0:20916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2200/0x892c60dda91c90f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c90ff expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788528657.264735:0:17125:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c0030c00/0x892c60dda91c8f4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c8f54 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528657.264741:0:17125:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c0030c00/0x892c60dda91c8f4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x892c60dda91c8f54 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528657.264746:0:20916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788528657.264753:0:20916:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.203.138@tcp: clear params 00010000:00010000:2.0:1788528657.264757:0:20916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428000/0x892c60dda91c8c2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8c36 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528657.264764:0:20916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428000/0x892c60dda91c8c2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8c36 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528657.264770:0:20916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428000/0x892c60dda91c8c2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c8c36 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528657.264776:0:20916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428000/0x892c60dda91c8c2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c8c36 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528657.264782:0:20916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788528657.264787:0:20916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101850e00/0x892c60dda91c8c13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8c1a expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528657.264793:0:20916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101850e00/0x892c60dda91c8c13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8c1a expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528657.264804:0:20916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101850e00/0x892c60dda91c8c13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c8c1a expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528657.264811:0:20916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8a9101850e00/0x892c60dda91c8c13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c8c1a expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788528657.264817:0:17125:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c0030c00/0x892c60dda91c8f4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x892c60dda91c8f54 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528657.264818:0:20916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:3.0:1788528657.264823:0:17125:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788528657.264825:0:17125:0:(mgc_request.c:1180:mgc_blocking_ast()) log lustre-mdtir: stale lock, won't requeue 10000000:01000000:3.0:1788528657.264828:0:17125:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 10000000:01000000:2.0:1788528657.264845:0:20916:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.203.138@tcp: clear lustre-sptlrpc 10000000:01000000:2.0:1788528657.264847:0:20916:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:3.0:1788528657.264852:0:17125:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a90c5a9a000 00010000:00010000:3.0:1788528657.264855:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c0030c00/0x892c60dda91c8f4d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c8f54 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528657.264860:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c0030c00/0x892c60dda91c8f4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c8f54 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528657.264866:0:20916:0:(mgc_request.c:650:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:3.0:1788528657.264871:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788528657.264874:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2200/0x892c60dda91c90f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c90ff expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528657.264879:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc26e2200 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:3.0:1788528657.264881:0:17125:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2200/0x892c60dda91c90f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c90ff expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788528657.264883:0:20916:0:(tgt_mount.c:2175:server_put_super()) stopping lustre-MDT0001 00010000:00010000:3.0:1788528657.264887:0:17125:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2200/0x892c60dda91c90f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x892c60dda91c90ff expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:2.0:1788528657.264887:0:20916:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1788528657.264890:0:20916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 10000000:00010000:3.0:1788528657.264892:0:17125:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2200/0x892c60dda91c90f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x892c60dda91c90ff expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788528657.264896:0:20916:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 10000000:01000000:3.0:1788528657.264897:0:17125:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788528657.264898:0:17125:0:(mgc_request.c:1180:mgc_blocking_ast()) log params: stale lock, won't requeue 00000020:00080000:2.0:1788528657.264903:0:20916:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8a90d96b2800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:01000000:3.0:1788528657.264904:0:17125:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000020:00080000:2.0:1788528657.264908:0:20916:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8a90f6eee000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788528657.264913:0:20916:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff8a90fb078000) has exports, disconnecting them 00000020:00080000:2.0:1788528657.264917:0:20916:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8a90d96b2800), last request at 1788528656 00000020:00000080:2.0:1788528657.264924:0:20916:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8f3f 00000100:00080000:2.0:1788528657.264939:0:20916:0:(import.c:65:import_set_state_nolock()) ffff8a90d96b5800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788528657.264991:0:20916:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a90d96b2800): rc 0 00000020:00000080:2.0:1788528657.264994:0:20916:0:(genops.c:885:class_export_put()) final put ffff8a90d96b2800/lustre-MDT0001-lwp-OST0001_UUID 00010000:00010000:3.0:1788528657.265003:0:17125:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a90c5a9a000 00000020:00080000:2.0:1788528657.265004:0:20916:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8a90f6eee000), last request at 1788528656 00010000:00010000:3.0:1788528657.265006:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2200/0x892c60dda91c90f8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c90ff expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788528657.265007:0:20916:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8dcc 00000100:00080000:2.0:1788528657.265012:0:20916:0:(import.c:65:import_set_state_nolock()) ffff8a90f6eec000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788528657.265013:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2200/0x892c60dda91c90f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c90ff expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528657.265021:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:00000080:2.0:1788528657.265022:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90d96b2800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00010000:00010000:3.0:1788528657.265024:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428000/0x892c60dda91c8c2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c8c36 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528657.265030:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428000 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:3.0:1788528657.265032:0:17125:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428000/0x892c60dda91c8c2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c8c36 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528657.265039:0:17125:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428000/0x892c60dda91c8c2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x892c60dda91c8c36 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788528657.265044:0:17125:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428000/0x892c60dda91c8c2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x892c60dda91c8c36 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528657.265049:0:17125:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788528657.265051:0:17125:0:(mgc_request.c:1180:mgc_blocking_ast()) log lustre-barrier: stale lock, won't requeue 10000000:01000000:3.0:1788528657.265053:0:17125:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000020:00000080:2.0:1788528657.265058:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a90d96b5800 for lustre-MDT0001 00010000:00010000:3.0:1788528657.265073:0:17125:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a90c5a9a000 00000020:00080000:2.0:1788528657.265075:0:20916:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a90f6eee000): rc 0 00010000:00010000:3.0:1788528657.265076:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428000/0x892c60dda91c8c2f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c8c36 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788528657.265077:0:20916:0:(genops.c:885:class_export_put()) final put ffff8a90f6eee000/lustre-MDT0001-lwp-OST0000_UUID 00010000:00010000:3.0:1788528657.265083:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428000/0x892c60dda91c8c2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c8c36 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00000080:2.0:1788528657.265086:0:20916:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffff9b7a01777ae0 00000020:00000080:2.0:1788528657.265096:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90f6eee000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00010000:00010000:3.0:1788528657.265101:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788528657.265104:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a9101850e00/0x892c60dda91c8c13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c8c1a expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528657.265109:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101850e00 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:3.0:1788528657.265112:0:17125:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a9101850e00/0x892c60dda91c8c13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c8c1a expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528657.265118:0:17125:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a9101850e00/0x892c60dda91c8c13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x892c60dda91c8c1a expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788528657.265121:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a90f6eec000 for lustre-MDT0001 10000000:00010000:3.0:1788528657.265124:0:17125:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a9101850e00/0x892c60dda91c8c13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x892c60dda91c8c1a expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528657.265129:0:17125:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788528657.265132:0:17125:0:(mgc_request.c:1180:mgc_blocking_ast()) log lustre-sptlrpc: stale lock, won't requeue 10000000:01000000:3.0:1788528657.265133:0:17125:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788528657.265158:0:17125:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a90c5a9a000 00010000:00010000:3.0:1788528657.265161:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a9101850e00/0x892c60dda91c8c13 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c8c1a expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528657.265167:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a9101850e00/0x892c60dda91c8c13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c8c1a expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528657.265176:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528657.265178:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528657.265179:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528657.265203:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528657.265303:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788528657.265370:0:20916:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788528657.265379:0:20916:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff8a8fc3eb0a80 x1875407735582848/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788528672 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528657.265398:0:20916:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00100000:1.0:1788528657.265861:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3eb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735582848:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1788528657.266471:0:20916:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788528657.266478:0:20916:0:(import.c:65:import_set_state_nolock()) ffff8a90c83a9800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788528657.266847:0:20916:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788528657.266851:0:20916:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1788528657.266889:0:20916:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788528657.266957:0:20916:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788528657.266978:0:20916:0:(import.c:65:import_set_state_nolock()) ffff8a90f6ee8800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788528657.266998:0:20916:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788528657.267000:0:20916:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1788528657.267013:0:20916:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788528657.267068:0:20916:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788528657.267076:0:20916:0:(import.c:65:import_set_state_nolock()) ffff8a90f58dd000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788528657.267109:0:20916:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8a90fb078000) has no exports 00000100:00100000:3.0:1788528657.267321:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735584256:0@lo:9:umount.0 00000100:00100000:3.0:1788528657.267388:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528657.267425:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735584384:0@lo:9:umount.0 00000100:00100000:3.0:1788528657.267452:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528657.267721:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735584256 00000100:00100000:0.0:1788528657.267729:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735584256 00000100:00100000:0.0:1788528657.267778:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735584384 00000100:00100000:0.0:1788528657.267781:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735584384 00000100:00100000:0.0:1788528657.267814:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788528657.267823:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875407735584256:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788528657.267845:0:18644:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8df6 00000100:00080000:0.0:1788528657.267853:0:18644:0:(import.c:65:import_set_state_nolock()) ffff8a90f5ad8800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788528657.267872:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788528657.267881:0:18646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875407735584384:12345-0@lo:9:umount.0 00000001:00000004:0.0:1788528657.267889:0:18644:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000020:00000080:1.0:1788528657.267893:0:18646:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8f70 00000100:00080000:1.0:1788528657.267898:0:18646:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3d1d000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788528657.267933:0:18646:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1788528657.268007:0:18646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3636:x1875407735584384:12345-0@lo:9:umount.0 Request processed in 127us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528657.268007:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3636:x1875407735584256:12345-0@lo:9:umount.0 Request processed in 185us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528657.268015:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788528657.268119:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:3.0:1788528657.268225:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788528657.268275:0:17133:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788528657.268305:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90f6ee8800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788528657.268318:0:3636:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788528657.268320:0:3636:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788528657.268323:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735584256:0@lo:9:umount.0 00000100:00080000:0.0:1788528657.268343:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90f58dd000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788528657.268353:0:3636:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788528657.268354:0:3636:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788528657.268357:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735584384:0@lo:9:umount.0 00010000:00010000:0.0:1788528657.268375:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788528657.273802:0:20916:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8a90fb078000) has no exports 00000020:01000000:0.0:1788528657.328250:0:20916:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a8fc241f900 - data ffff8a90f0c44798/ffff8a8fc3084400 00000020:01000000:0.0:1788528657.328415:0:20916:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a90f59920c0 - data ffff8a90f0d87510/ffff8a90f6c18c00 00000001:00000004:0.0:1788528657.339372:0:20916:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:2.0:1788528657.390874:0:20916:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788528657.390883:0:20916:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788528657.390890:0:20916:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788528657.392429:0:20916:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788528657.392435:0:20916:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1788528657.392455:0:20916:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788528657.392472:0:20916:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788528657.392969:0:17879:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788528657.392974:0:17879:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:1.0:1788528657.392987:0:17879:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1788528657.393844:0:20916:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788528657.393848:0:20916:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1788528657.393869:0:20916:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788528657.393872:0:20916:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788528657.394242:0:17881:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788528657.394246:0:17881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1788528657.394254:0:17881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1788528657.395202:0:20916:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8c52 00000020:00000080:2.0:1788528657.395213:0:20916:0:(genops.c:885:class_export_put()) final put ffff8a8fc3c57800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788528657.397123:0:20916:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8c67 00000020:00000080:2.0:1788528657.397135:0:20916:0:(genops.c:885:class_export_put()) final put ffff8a90f6f36800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788528657.397991:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc3c57800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1788528657.398852:0:20916:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1788528657.398861:0:20916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788528657.398869:0:20916:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788528657.398874:0:20916:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8a9101959980) has no exports 00000020:00000080:0.0:1788528657.398978:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90f6f36800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:2.0:1788528657.399161:0:20916:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788528657.399172:0:20916:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8cbb 00000020:00000080:2.0:1788528657.399179:0:20916:0:(genops.c:885:class_export_put()) final put ffff8a90c83ae000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788528657.399193:0:20916:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1788528657.399197:0:20916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788528657.399202:0:20916:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788528657.399205:0:20916:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8a8fc35e1980) has no exports 00000020:00000080:2.0:1788528657.399211:0:20916:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8cb4 00000020:00000080:2.0:1788528657.399215:0:20916:0:(genops.c:885:class_export_put()) final put ffff8a90f58ab000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788528657.399619:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90c83ae000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1788528657.399626:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90f58ab000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1788528657.399973:0:20916:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1788528657.399978:0:20916:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788528657.399982:0:20916:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:2.0:1788528657.399988:0:20916:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788528657.399991:0:20916:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788528657.400055:0:20916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788528657.400063:0:20916:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788528657.400067:0:20916:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8ca6 00000020:00000080:2.0:1788528657.400072:0:20916:0:(genops.c:885:class_export_put()) final put ffff8a8fc3d0e800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788528657.405479:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a90f58dd000 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1788528657.405496:0:8:0:(genops.c:885:class_export_put()) final put ffff8a8fc3d0c800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788528657.405499:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc3d0c800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1788528657.405506:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1788528657.405714:0:20916:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1788528657.405721:0:20916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788528657.405743:0:20916:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788528657.405758:0:20916:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8a90f7deb300) has no exports 00000020:00000080:2.0:1788528657.405766:0:20916:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8c98 00000020:00000080:2.0:1788528657.405773:0:20916:0:(genops.c:885:class_export_put()) final put ffff8a90f6eee800/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1788528657.406274:0:20916:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1788528657.406278:0:20916:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788528657.406283:0:20916:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:2.0:1788528657.406289:0:20916:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788528657.406291:0:20916:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788528657.406612:0:20916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788528657.406620:0:20916:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1788528657.406645:0:20916:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1788528657.406652:0:20916:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8c8a 00000020:00000080:2.0:1788528657.406657:0:20916:0:(genops.c:885:class_export_put()) final put ffff8a90f6eeb800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788528657.406663:0:20916:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1788528657.406667:0:20916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788528657.406671:0:20916:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788528657.406673:0:20916:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8a90fb07e600) has no exports 00000020:00000080:2.0:1788528657.406677:0:20916:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8c83 00000020:00000080:2.0:1788528657.406681:0:20916:0:(genops.c:885:class_export_put()) final put ffff8a90c83a8000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788528657.407684:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc3d0e800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1788528657.407698:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90f6eee800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788528657.407703:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a90f6ee8800 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1788528657.407711:0:8:0:(genops.c:885:class_export_put()) final put ffff8a90f6eec800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788528657.407713:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90f6eec800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1788528657.407718:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788528657.407802:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90f6eeb800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1788528657.407808:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90c83a8000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788528657.408928:0:20916:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1788528657.408934:0:20916:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788528657.408948:0:20916:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788528657.408955:0:20916:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788528657.409007:0:20916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788528657.409018:0:20916:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788528657.409044:0:20916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788528657.409048:0:20916:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788528657.409052:0:20916:0:(genops.c:885:class_export_put()) final put ffff8a8fc3c57000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788528657.409056:0:20916:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc3c57000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1788528657.409061:0:20916:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788528657.409185:0:20916:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8c6e 00000020:00000080:0.0:1788528657.409193:0:20916:0:(genops.c:885:class_export_put()) final put ffff8a90f6f30800/lustre-MDD0001_UUID 00000020:01000000:0.0:1788528657.409197:0:20916:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1788528657.409201:0:20916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788528657.409205:0:20916:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788528657.409209:0:20916:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8a90fb07b300) has no exports 00000020:00000080:0.0:1788528657.409229:0:20916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788528657.409232:0:20916:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1788528657.409236:0:20916:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8c75 00000020:00000080:0.0:1788528657.409240:0:20916:0:(genops.c:885:class_export_put()) final put ffff8a90f6f34000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1788528657.409247:0:20916:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8a90f6c03000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1788528657.409249:0:20916:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8a90f6c03000 2 00000020:01000004:0.0:1788528657.409252:0:20916:0:(tgt_mount.c:134:server_deregister_mount()) deregister mount ffff8a90f6c03000 from lustre-MDT0001 00000020:00000080:0.0:1788528657.409268:0:20916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788528657.409271:0:20916:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1788528657.409273:0:20916:0:(genops.c:885:class_export_put()) final put ffff8a8fc3c55800/lustre-MDT0001_UUID 00000020:00000080:0.0:1788528657.409275:0:20916:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc3c55800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1788528657.409282:0:20916:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1788528657.409313:0:20916:0:(obd_mount.c:580:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1788528657.409317:0:20916:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1788528657.409320:0:20916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788528657.409324:0:20916:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788528657.409330:0:20916:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8a90f6eeb000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788528657.409341:0:20916:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff8a90ce969980) has exports, disconnecting them 00000020:00080000:0.0:1788528657.409346:0:20916:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8a90f6eeb000), last request at 1788528574 00000020:00000080:0.0:1788528657.409350:0:20916:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8cf3 00000020:00080000:0.0:1788528657.409361:0:20916:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a90f6eeb000): rc 0 00000020:00000080:0.0:1788528657.409364:0:20916:0:(genops.c:885:class_export_put()) final put ffff8a90f6eeb000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788528657.410111:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a90c83a9800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788528657.410119:0:8:0:(genops.c:885:class_export_put()) final put ffff8a90c83ae800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788528657.410121:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90c83ae800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1788528657.410132:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788528657.410226:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90f6f30800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1788528657.410230:0:8:0:(genops.c:885:class_export_put()) final put ffff8a8fc3c50800/lustre-MDD0001_UUID 00000020:00000080:1.0:1788528657.410232:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc3c50800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1788528657.410236:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1788528657.410347:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90f6f34000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788528657.410352:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90f6eeb000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1788528657.483116:0:20916:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1788528657.483125:0:20916:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788528657.483129:0:20916:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788528657.483137:0:20916:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788528657.483164:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a90c5a9b000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788528657.483351:0:20916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788528657.483378:0:20916:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1788528657.483385:0:20916:0:(genops.c:885:class_export_put()) final put ffff8a90c7d57800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1788528657.483388:0:20916:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90c7d57800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1788528657.483405:0:20916:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1788528657.483478:0:20916:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8a90f6c03000 1 00000020:00000080:1.0:1788528657.483484:0:20916:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8c0c 00000020:00000080:1.0:1788528657.483490:0:20916:0:(genops.c:885:class_export_put()) final put ffff8a90c7f8e000/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1788528657.483499:0:20916:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1788528657.483506:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90c7f8e000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788528657.483515:0:20916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788528657.483520:0:20916:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788528657.483524:0:20916:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8a910195cc80) has no exports 00010000:00010000:1.0:1788528657.507465:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788528657.525344:0:20916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788528657.525358:0:20916:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1788528657.525364:0:20916:0:(genops.c:885:class_export_put()) final put ffff8a90f6c00000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788528657.525426:0:20916:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90f6c00000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1788528657.525442:0:20916:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1788528657.525601:0:20916:0:(obd_mount.c:670:lustre_free_lsi()) Freeing lsi ffff8a90f6c03800 00000020:01000000:1.0:1788528657.528196:0:20916:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788528657.528209:0:20916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788528657.528219:0:20916:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788528657.528224:0:20916:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8a910195b300) has no exports 00000100:00100000:1.0:1788528657.528350:0:19473:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8a8fc1c3d000:19473] 3 exiting: rc = 0 00000100:00100000:1.0:1788528657.528459:0:17137:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8a90f6fa5400:17137] 0 exiting: rc = 1 00000100:00100000:2.0:1788528657.528474:0:20478:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8a90fb0c9600:20478] 4 exiting: rc = 0 00000100:00100000:1.0:1788528657.528521:0:17139:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8a90f6fa4000:17139] 2 exiting: rc = 0 00000100:00100000:0.0:1788528657.530649:0:17138:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8a90f6fa5000:17138] 1 exiting: rc = 0 00000100:00100000:1.0:1788528657.531165:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531176:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531184:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531190:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531198:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531206:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531214:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531224:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531232:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531239:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531246:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531253:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531259:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531269:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531279:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531289:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531294:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531299:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531308:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531316:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531321:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531327:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531333:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531340:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531357:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531362:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531368:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531373:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531378:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531384:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531389:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531394:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531400:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531405:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531411:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531417:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531425:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531433:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531441:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531448:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531454:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531461:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531469:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531475:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531480:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531487:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531493:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531500:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531506:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531512:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531518:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531524:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531530:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531537:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531545:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531567:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531575:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531582:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531587:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531600:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531608:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531615:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531622:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.531637:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528657.535924:0:17141:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8a90f6fbb000:17141] 1 exiting: rc = 0 00000100:00100000:0.0:1788528657.536118:0:17140:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8a90f6fa5c00:17140] 0 exiting: rc = 1 00000100:00100000:1.0:1788528657.536277:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536287:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536297:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536303:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536309:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536314:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536319:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536325:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536333:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536340:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536345:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536350:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536355:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536359:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536364:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536369:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536447:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536455:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536461:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536476:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536487:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536494:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536500:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536508:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536515:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536522:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536527:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536541:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536550:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536572:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536590:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536595:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536601:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536610:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536618:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536639:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536652:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536658:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536663:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536668:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536673:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536844:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536855:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536863:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536874:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536882:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536893:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536898:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536904:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536909:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536914:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536919:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536924:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536929:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536941:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536948:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536954:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.536959:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.537030:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.537040:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.537047:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.537053:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.537061:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.537068:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.538284:0:17143:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8a8fc275c600:17143] 1 exiting: rc = 0 00000100:00100000:2.0:1788528657.538343:0:17142:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8a8fc275d600:17142] 0 exiting: rc = 1 00000100:00100000:1.0:1788528657.538497:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.538516:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.538525:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.538533:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.538572:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.538583:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.538598:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.538605:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.538610:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.538618:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.538626:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.538644:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.538653:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.538663:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.538673:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.538691:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.538700:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.538707:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.538729:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.538737:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.538742:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.538747:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.538753:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.538759:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.538766:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.538774:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.538780:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.538786:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.538792:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.538798:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.539756:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.539768:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.539775:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.539783:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.539789:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.539795:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.539811:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.539816:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.539821:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.539825:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.539831:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.539837:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.539864:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.539873:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.539882:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.539895:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.539907:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.539919:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.539924:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.539930:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.539935:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.539947:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.540042:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.540051:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.540083:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.540091:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.540096:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.540102:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.540109:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.540115:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.540121:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.540127:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.540134:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.540261:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528657.557418:0:17145:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8a90f6fba400:17145] 1 exiting: rc = 0 00000100:00100000:0.0:1788528657.557418:0:17144:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8a90f6fbbe00:17144] 0 exiting: rc = 1 00000100:00100000:1.0:1788528657.559308:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559318:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559323:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559327:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559333:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559338:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559343:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559361:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559367:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559435:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559508:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559512:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559517:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559523:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559528:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559533:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559657:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559664:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559669:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559674:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559746:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559753:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559758:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559764:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559769:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559774:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559779:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559784:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559789:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559795:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559800:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559806:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559811:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559816:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559822:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559828:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559834:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559839:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559844:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559850:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559855:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559861:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559873:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559878:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559883:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559889:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559894:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559898:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559903:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559909:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559913:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559918:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559923:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559928:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559933:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559938:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559943:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559947:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559953:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.559958:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.560036:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.560044:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.560049:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.560054:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.561044:0:17147:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8a90d16c8800:17147] 1 exiting: rc = 0 00000100:00100000:2.0:1788528657.561211:0:17146:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8a90d13b0200:17146] 0 exiting: rc = 1 00000100:00100000:1.0:1788528657.561518:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.561526:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.561533:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.561830:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.561838:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.561844:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.561848:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.561853:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.561859:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.561864:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.561869:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.561875:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.561880:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.561900:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.561906:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.561912:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.561917:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.561923:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.561929:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.561934:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.561940:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.561945:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.561950:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.561956:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.561961:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.562040:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.562045:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.562051:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.562056:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.562060:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.562065:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.562070:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.562076:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.562081:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.562087:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.562092:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.562097:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.562102:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.562108:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.562113:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.562118:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.562124:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.562129:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.562134:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.562267:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.562275:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.562280:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.562285:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.562298:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.562303:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.562308:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.562313:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.562318:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.562324:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.562328:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.562332:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.562337:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.562342:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.562346:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.562351:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.562356:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.562361:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.562366:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.562371:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528657.563382:0:17148:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8a90d13b0400:17148] 0 exiting: rc = 1 00000100:00100000:0.0:1788528657.563871:0:17149:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8a90f6e07a00:17149] 1 exiting: rc = 0 00000100:00100000:1.0:1788528657.563984:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.563991:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.563997:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564002:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564007:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564013:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564019:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564025:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564030:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564036:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564040:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564046:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564051:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564055:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564061:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564067:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564073:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564079:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564085:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564101:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564106:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564112:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564117:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564122:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564126:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564132:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564136:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564272:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564277:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564282:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564287:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564291:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564296:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564301:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564306:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564311:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564316:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564321:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564326:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564330:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564335:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564340:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564345:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564349:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564353:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564358:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564363:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564368:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564373:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564504:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564515:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564522:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564529:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564830:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564845:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564850:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564855:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564860:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564865:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564870:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564875:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564880:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564885:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528657.564890:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528657.566118:0:17150:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8a8fc3c59800:17150] 0 exiting: rc = 1 00000100:00100000:2.0:1788528657.566507:0:17152:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8a8fc3c59400:17152] 2 exiting: rc = 0 00000100:00100000:1.0:1788528657.567938:0:17151:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8a8fc3c58800:17151] 1 exiting: rc = 0 00000100:00100000:0.0:1788528657.568089:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.568098:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.568104:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.568110:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.568116:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.568121:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.568127:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.568132:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.568267:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.568276:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.568291:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.568298:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.568304:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.568309:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.568315:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.568321:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.568326:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.568331:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.568337:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.568343:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.568348:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.568368:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.568433:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.568439:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.568887:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.568896:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.568902:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.568908:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.568914:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.568919:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.568925:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.568930:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.568936:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.568943:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.568964:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.568970:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.568977:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.568984:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.568989:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.568995:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.569001:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.569007:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.569013:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.569019:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.569025:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.569030:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.569036:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.569042:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.569048:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.569055:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.569061:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.569068:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.569073:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.569078:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.569095:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.569102:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.569115:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.569121:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.569127:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.569132:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.569497:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.569507:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.569513:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528657.569520:0:20916:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788528657.582051:0:20916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788528657.582065:0:20916:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788528657.582072:0:20916:0:(genops.c:885:class_export_put()) final put ffff8a8fc477e000/MDS_uuid 00000020:00000080:0.0:1788528657.582076:0:20916:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc477e000/MDS_uuid for MDS 00000020:01000000:0.0:1788528657.582081:0:20916:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788528657.582222:0:20916:0:(tgt_mount.c:2258:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1788528658.570000:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528659.586678:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528660.607852:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788528660.852980:0:21118:0:(tgt_mount.c:2269:server_umount_begin()) umount -f 00000020:01000004:2.0:1788528660.868902:0:21118:0:(tgt_mount.c:2125:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788528660.868972:0:21118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101851000/0x892c60dda91c8d9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8da2 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528660.869006:0:21118:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101851000/0x892c60dda91c8d9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8da2 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528660.869013:0:21118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101851000/0x892c60dda91c8d9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c8da2 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528660.869020:0:21118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8a9101851000/0x892c60dda91c8d9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c8da2 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528660.869044:0:21118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788528660.869068:0:21118:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.203.138@tcp: clear lustre-client 10000000:01000000:2.0:1788528660.869072:0:21118:0:(mgc_request.c:650:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788528660.869110:0:21118:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788528660.869114:0:21118:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788528660.869121:0:21118:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788528660.869127:0:21118:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3109000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788528660.869132:0:21118:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788528660.869134:0:21118:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788528660.869137:0:21118:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788528660.869733:0:19476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528660.869743:0:19476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a9101851000/0x892c60dda91c8d9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c8da2 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528660.869753:0:19476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101851000 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:0.0:1788528660.869756:0:19476:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a9101851000/0x892c60dda91c8d9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c8da2 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528660.869765:0:19476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a9101851000/0x892c60dda91c8d9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x892c60dda91c8da2 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788528660.869773:0:19476:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a9101851000/0x892c60dda91c8d9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x892c60dda91c8da2 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528660.869779:0:19476:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788528660.869782:0:19476:0:(mgc_request.c:1180:mgc_blocking_ast()) log lustre-client: stale lock, won't requeue 10000000:01000000:0.0:1788528660.869784:0:19476:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788528660.869820:0:19476:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a90c5a9a000 00010000:00010000:0.0:1788528660.869834:0:19476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a9101851000/0x892c60dda91c8d9b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c8da2 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528660.869842:0:19476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a9101851000/0x892c60dda91c8d9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c8da2 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528660.869854:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528660.869856:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528660.869858:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788528660.870254:0:21118:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788528660.870259:0:21118:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788528660.870264:0:21118:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788528660.870287:0:21118:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3020000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788528660.870373:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1875407735584512:0@lo:39:umount.0 00000400:00000100:0.0:1788528660.870423:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875407735584512 offset 0 length 224: 4 00010000:00010000:3.0:1788528661.633547:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788528661.696891:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 463b8984-c30b-4b73-b2f1-81113bd4e10a->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788528661.696902:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788528661.696905:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a90c5a9a000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788528661.696914:0:8:0:(import.c:545:import_select_connection()) MGC192.168.203.138@tcp: connect to NID 0@lo last attempt 525 00000100:00080000:3.0:1788528661.696920:0:8:0:(import.c:630:import_select_connection()) MGC192.168.203.138@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788528661.696928:0:8:0:(import.c:665:import_select_connection()) MGC192.168.203.138@tcp: import ffff8a90c5a9a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1788528661.696965:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90fa8af800 x1875407735584640/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788528661.697004:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788528661.697008:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788528661.697010:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3144000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788528661.697014:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 525 00000100:00080000:3.0:1788528661.697017:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788528661.697021:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a8fc3144000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1788528661.697037:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90fa8aed80 x1875407735584768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788528661.697176:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1875407735584896:0@lo:400:kworker.0 00000400:00000100:1.0:1788528661.697229:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875407735584896 offset 0 length 224: 4 00000100:00100000:0.0:1788528661.700768:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:463b8984-c30b-4b73-b2f1-81113bd4e10a:3636:1875407735584640:0@lo:250:kworker.0 00000100:00100000:0.0:1788528661.700846:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528661.700898:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1875407735584768:0@lo:38:kworker.0 00000400:00000100:0.0:1788528661.700920:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875407735584768 offset 0 length 520: 4 00000100:00100000:1.0:1788528661.701024:0:20804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735584640 00000100:00100000:1.0:1788528661.701032:0:20804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735584640 00000100:00100000:1.0:1788528661.701077:0:20804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788528661.701085:0:20804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc308f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3636:x1875407735584640:12345-0@lo:250:kworker.0 00010000:00000400:1.0:1788528661.701101:0:20804:0:(ldlm_lib.c:1248:target_handle_connect()) MGS: refusing connection from 0@lo: this is an MGS follower, which only serves clients that support it: rc = -19 00000100:00100000:1.0:1788528661.701168:0:20804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc308f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3636:x1875407735584640:12345-0@lo:250:kworker.0 Request processed in 82us (320us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788528661.701175:0:20804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788528661.701409:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90c5a9a000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788528661.701415:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-19) 00000100:00100000:0.0:1788528661.701419:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:463b8984-c30b-4b73-b2f1-81113bd4e10a:3636:1875407735584640:0@lo:250:kworker.0 00010000:00010000:1.0:1788528662.655180:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788528662.720262:0:18640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788528662.720271:0:18640:0:(genops.c:885:class_export_put()) final put ffff8a90f5adc800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788528662.720633:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90f5adc800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000001:00100000:0.0:1788528662.720752:0:19458:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788528662.720757:0:19458:0:(genops.c:885:class_export_put()) final put ffff8a8fc3d1c000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788528662.720762:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a90f5ad8800 for lustre-OST0000 00000020:00000080:3.0:1788528662.720770:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc3d1c000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788528662.720788:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a8fc3d1d000 for lustre-OST0001 00010000:00010000:0.0:1788528663.683053:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528664.702847:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528665.726844:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528666.750906:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788528666.814990:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) 463b8984-c30b-4b73-b2f1-81113bd4e10a->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788528666.815000:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788528666.815020:0:469:0:(import.c:65:import_set_state_nolock()) ffff8a90c5a9a000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788528666.815027:0:469:0:(import.c:545:import_select_connection()) MGC192.168.203.138@tcp: connect to NID 0@lo last attempt 530 00000100:00080000:2.0:1788528666.815042:0:469:0:(import.c:630:import_select_connection()) MGC192.168.203.138@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788528666.815048:0:469:0:(import.c:665:import_select_connection()) MGC192.168.203.138@tcp: import ffff8a90c5a9a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1788528666.815079:0:469:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90faa0b100 x1875407735585024/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788528666.815136:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:463b8984-c30b-4b73-b2f1-81113bd4e10a:3636:1875407735585024:0@lo:250:kworker.0 00000100:00100000:3.0:1788528666.815205:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528666.815320:0:20804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735585024 00000100:00100000:1.0:1788528666.815329:0:20804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735585024 00000100:00100000:1.0:1788528666.815379:0:20804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788528666.815387:0:20804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c68f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3636:x1875407735585024:12345-0@lo:250:kworker.0 00010000:00000400:1.0:1788528666.815404:0:20804:0:(ldlm_lib.c:1248:target_handle_connect()) MGS: refusing connection from 0@lo: this is an MGS follower, which only serves clients that support it: rc = -19 00000100:00080000:2.0:1788528666.815815:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788528666.815820:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788528666.815875:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788528666.815886:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1875407735585152:0@lo:400:kworker.0 00000400:00000100:2.0:1788528666.815912:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875407735585152 offset 0 length 224: 4 00000100:00100000:1.0:1788528666.822026:0:20804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c68f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3636:x1875407735585024:12345-0@lo:250:kworker.0 Request processed in 6629us (6810us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788528666.822058:0:20804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788528666.827628:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90c5a9a000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788528666.827643:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-19) 00000100:00100000:3.0:1788528666.827648:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:463b8984-c30b-4b73-b2f1-81113bd4e10a:3636:1875407735585024:0@lo:250:kworker.0 00010000:00010000:3.0:1788528667.774891:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528668.800159:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528669.822775:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528670.847164:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528670.910688:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788528660/real 1788528660] req@ffff8a90faa09c00 x1875407735584512/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788528670 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528670.910724:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a90faa09c00 x1875407735584512/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788528670 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788528670.910744:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3020000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788528670.910770:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1875407735584512:0@lo:39:umount.0 00000100:00080000:2.0:1788528670.910868:0:21118:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788528670.910873:0:21118:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788528670.910879:0:21118:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788528670.912029:0:21118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429600/0x892c60dda91c8d71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8d78 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528670.912044:0:21118:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429600/0x892c60dda91c8d71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8d78 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528670.912051:0:21118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429600/0x892c60dda91c8d71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c8d78 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528670.912057:0:21118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429600/0x892c60dda91c8d71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c8d78 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528670.912624:0:21118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788528670.912661:0:21118:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.203.138@tcp: clear lustre-OST0000 00010000:00010000:2.0:1788528670.912670:0:21118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83e00/0x892c60dda91c90ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c90f1 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528670.912678:0:21118:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83e00/0x892c60dda91c90ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c90f1 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528670.912685:0:21118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83e00/0x892c60dda91c90ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c90f1 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528670.912690:0:21118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83e00/0x892c60dda91c90ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c90f1 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528670.920564:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788528670.920579:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429600/0x892c60dda91c8d71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c8d78 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528670.920591:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3429600 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:3.0:1788528670.920595:0:17126:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429600/0x892c60dda91c8d71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c8d78 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528670.920605:0:17126:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429600/0x892c60dda91c8d71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x892c60dda91c8d78 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788528670.920613:0:17126:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429600/0x892c60dda91c8d71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x892c60dda91c8d78 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528670.920635:0:17126:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788528670.920638:0:17126:0:(mgc_request.c:1180:mgc_blocking_ast()) log lustre-OST0000: stale lock, won't requeue 00010000:00010000:3.0:1788528670.920654:0:17126:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a90c5a9a000 00010000:00010000:3.0:1788528670.920658:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429600/0x892c60dda91c8d71 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c8d78 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528670.920664:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a8fc3429600/0x892c60dda91c8d71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c8d78 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528670.920681:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788528670.920685:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83e00/0x892c60dda91c90ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c90f1 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528670.920690:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c6c83e00 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:3.0:1788528670.920693:0:17126:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83e00/0x892c60dda91c90ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c90f1 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528670.920700:0:17126:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83e00/0x892c60dda91c90ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x892c60dda91c90f1 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788528670.920706:0:17126:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83e00/0x892c60dda91c90ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x892c60dda91c90f1 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528670.920711:0:17126:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788528670.920713:0:17126:0:(mgc_request.c:1187:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1788528670.920717:0:17126:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a90c5a9a000 00010000:00010000:3.0:1788528670.920722:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83e00/0x892c60dda91c90ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c90f1 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528670.920739:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528670.920741:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528670.920743:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528670.920916:0:21118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788528670.920924:0:21118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83e00/0x892c60dda91c90ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c90f1 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528670.920952:0:21118:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.203.138@tcp: clear params 10000000:01000000:2.0:1788528670.920955:0:21118:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788528670.921005:0:21118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428800/0x892c60dda91c8d63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8d6a expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528670.921013:0:21118:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428800/0x892c60dda91c8d63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8d6a expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528670.921020:0:21118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428800/0x892c60dda91c8d63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c8d6a expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528670.921026:0:21118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428800/0x892c60dda91c8d63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c8d6a expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528670.921056:0:21118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788528670.921113:0:21118:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.203.138@tcp: clear lustre-sptlrpc 10000000:01000000:2.0:1788528670.921117:0:21118:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:2.0:1788528670.921134:0:21118:0:(mgc_request.c:650:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788528670.921159:0:21118:0:(tgt_mount.c:2175:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788528670.921164:0:21118:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1788528670.921170:0:21118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788528670.921176:0:21118:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788528670.921180:0:21118:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8a90ce96cc80) has no exports 00000020:00080000:2.0:1788528670.921202:0:21118:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8a90ce96cc80) has no exports 00000020:01000000:2.0:1788528670.922860:0:21118:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a90f8f38780 - data ffff8a90f0d945e8/ffff8a8fc308fc00 00000020:01000000:2.0:1788528670.922983:0:21118:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a90f8f38d20 - data ffff8a8fc21b5ca8/ffff8a8fc33ce800 00010000:00010000:0.0:1788528670.923498:0:19476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528670.923507:0:19476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428800/0x892c60dda91c8d63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c8d6a expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528670.923548:0:19476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc3428800 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:0.0:1788528670.923589:0:19476:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428800/0x892c60dda91c8d63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c8d6a expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528670.923600:0:19476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428800/0x892c60dda91c8d63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x892c60dda91c8d6a expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788528670.923606:0:19476:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428800/0x892c60dda91c8d63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x892c60dda91c8d6a expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528670.923611:0:19476:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788528670.923613:0:19476:0:(mgc_request.c:1180:mgc_blocking_ast()) log lustre-sptlrpc: stale lock, won't requeue 10000000:01000000:0.0:1788528670.923616:0:19476:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788528670.923653:0:19476:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a90c5a9a000 00010000:00010000:0.0:1788528670.923656:0:19476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428800/0x892c60dda91c8d63 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c8d6a expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528670.923662:0:19476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a8fc3428800/0x892c60dda91c8d63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c8d6a expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528670.923673:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528670.923675:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528670.923677:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528670.924047:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788528670.941728:0:21118:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788528670.952515:0:21118:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8d86 00000020:00000080:2.0:1788528670.952527:0:21118:0:(genops.c:885:class_export_put()) final put ffff8a8fc310e800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788528670.952582:0:21118:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8a90fe6bc000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788528670.952587:0:21118:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8a90fe6bc000 2 00000020:01000004:2.0:1788528670.952590:0:21118:0:(tgt_mount.c:134:server_deregister_mount()) deregister mount ffff8a90fe6bc000 from lustre-OST0000 00000020:00000080:1.0:1788528670.952596:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc310e800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788528670.952620:0:21118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788528670.952633:0:21118:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788528670.952636:0:21118:0:(genops.c:885:class_export_put()) final put ffff8a90c7d56800/lustre-OST0000_UUID 00000020:00000080:2.0:1788528670.952638:0:21118:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90c7d56800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788528670.952645:0:21118:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1788528670.952853:0:21118:0:(obd_mount.c:580:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1788528670.952858:0:21118:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788528670.952862:0:21118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788528670.952868:0:21118:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788528670.952874:0:21118:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8a8fc3025800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788528670.952880:0:21118:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff8a90ce968000) has exports, disconnecting them 00000020:00080000:1.0:1788528670.952885:0:21118:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8a8fc3025800), last request at 1788528589 00000020:00000080:1.0:1788528670.952890:0:21118:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8db0 00000020:00080000:1.0:1788528670.952900:0:21118:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a8fc3025800): rc 0 00000020:00000080:1.0:1788528670.952906:0:21118:0:(genops.c:885:class_export_put()) final put ffff8a8fc3025800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788528670.953019:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc3025800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788528670.957833:0:21118:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788528670.957842:0:21118:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788528670.957846:0:21118:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788528670.957856:0:21118:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788528670.958058:0:21118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788528670.958068:0:21118:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1788528670.958077:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a8fc3109000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788528670.958102:0:21118:0:(genops.c:885:class_export_put()) final put ffff8a8fc3108800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788528670.958107:0:21118:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc3108800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788528670.958119:0:21118:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1788528670.958182:0:21118:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788528670.958186:0:21118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788528670.958191:0:21118:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788528670.958199:0:21118:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8a8fc3022000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788528670.958205:0:21118:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff8a8fc35e0000) has exports, disconnecting them 00000020:00080000:0.0:1788528670.958381:0:21118:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8a8fc3022000), last request at 1788528589 00000020:00000080:0.0:1788528670.958386:0:21118:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8dc5 00000020:00080000:0.0:1788528670.958400:0:21118:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a8fc3022000): rc 0 00000020:00000080:0.0:1788528670.958405:0:21118:0:(genops.c:885:class_export_put()) final put ffff8a8fc3022000/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1788528670.958443:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc3022000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1788528670.966720:0:21118:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788528670.966729:0:21118:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788528670.966745:0:21118:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788528670.966752:0:21118:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788528670.966782:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a8fc3020000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1788528670.966960:0:21118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788528670.966968:0:21118:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1788528670.966973:0:21118:0:(genops.c:885:class_export_put()) final put ffff8a8fc3021800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1788528670.966977:0:21118:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc3021800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1788528670.966988:0:21118:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1788528670.967058:0:21118:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8a90fe6bc000 1 00000020:00000080:2.0:1788528670.967064:0:21118:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8d55 00000020:00000080:2.0:1788528670.967071:0:21118:0:(genops.c:885:class_export_put()) final put ffff8a90f8f48000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788528670.967080:0:21118:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788528670.967101:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90f8f48000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788528670.967111:0:21118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788528670.967116:0:21118:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788528670.967119:0:21118:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff8a8fc35e4c80) has no exports 00000020:00000080:2.0:1788528670.993822:0:21118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788528670.993835:0:21118:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788528670.993842:0:21118:0:(genops.c:885:class_export_put()) final put ffff8a90fe6ba000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788528670.993846:0:21118:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90fe6ba000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788528670.994058:0:21118:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788528670.994177:0:21118:0:(obd_mount.c:670:lustre_free_lsi()) Freeing lsi ffff8a90fe6b9000 00000020:02000400:2.0:1788528670.994222:0:21118:0:(tgt_mount.c:2258:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788528671.871227:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788528671.937525:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) 463b8984-c30b-4b73-b2f1-81113bd4e10a->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788528671.937543:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788528671.937548:0:469:0:(import.c:65:import_set_state_nolock()) ffff8a90c5a9a000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788528671.937569:0:469:0:(import.c:545:import_select_connection()) MGC192.168.203.138@tcp: connect to NID 0@lo last attempt 536 00000100:00080000:0.0:1788528671.937575:0:469:0:(import.c:630:import_select_connection()) MGC192.168.203.138@tcp: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788528671.937582:0:469:0:(import.c:665:import_select_connection()) MGC192.168.203.138@tcp: import ffff8a90c5a9a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1788528671.937616:0:469:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90fe691f80 x1875407735585280/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788528671.937634:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788528671.937638:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788528671.937673:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788528671.937686:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1875407735585408:0@lo:400:kworker.0 00000100:00100000:3.0:1788528671.937725:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe691f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:463b8984-c30b-4b73-b2f1-81113bd4e10a:3636:1875407735585280:0@lo:250:kworker.0 00000400:00000100:0.0:1788528671.937736:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875407735585408 offset 0 length 224: 4 00000100:00100000:3.0:1788528671.943784:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528671.943859:0:20806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735585280 00000100:00100000:3.0:1788528671.943868:0:20806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735585280 00000100:00100000:3.0:1788528671.943903:0:20806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788528671.943911:0:20806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c68f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3636:x1875407735585280:12345-0@lo:250:kworker.0 00010000:00000400:3.0:1788528671.943929:0:20806:0:(ldlm_lib.c:1248:target_handle_connect()) MGS: refusing connection from 0@lo: this is an MGS follower, which only serves clients that support it: rc = -19 00000100:00100000:3.0:1788528671.943989:0:20806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c68f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3636:x1875407735585280:12345-0@lo:250:kworker.0 Request processed in 78us (210us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788528671.943996:0:20806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788528671.944046:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90c5a9a000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788528671.944052:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-19) 00000100:00100000:3.0:1788528671.944055:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe691f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:463b8984-c30b-4b73-b2f1-81113bd4e10a:3636:1875407735585280:0@lo:250:kworker.0 00010000:00010000:0.0:1788528672.902416:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528673.925939:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788528674.557306:0:21320:0:(tgt_mount.c:2269:server_umount_begin()) umount -f 00000020:01000004:2.0:1788528674.572984:0:21320:0:(tgt_mount.c:2125:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788528674.573087:0:21320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab200/0x892c60dda91c8f0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8f15 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528674.573102:0:21320:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab200/0x892c60dda91c8f0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8f15 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528674.573126:0:21320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab200/0x892c60dda91c8f0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c8f15 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528674.573134:0:21320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab200/0x892c60dda91c8f0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c8f15 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528674.573159:0:21320:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788528674.573175:0:21320:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.203.138@tcp: clear lustre-client 10000000:01000000:2.0:1788528674.573179:0:21320:0:(mgc_request.c:650:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788528674.573207:0:21320:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788528674.573218:0:21320:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a90fa8aed80 x1875407735584768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788528681 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528674.573242:0:21320:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788528674.573249:0:21320:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788528674.573255:0:21320:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3144000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788528674.573260:0:21320:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788528674.573263:0:21320:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a90fa8aed80 x1875407735584768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788528681 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528674.573270:0:21320:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788528674.573274:0:21320:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:0.0:1788528674.573346:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1875407735584768:0@lo:38:kworker.0 00010000:00010000:3.0:1788528674.573417:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788528674.573424:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab200/0x892c60dda91c8f0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c8f15 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528674.573432:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c14ab200 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:3.0:1788528674.573436:0:17126:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab200/0x892c60dda91c8f0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c8f15 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528674.573454:0:17126:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab200/0x892c60dda91c8f0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x892c60dda91c8f15 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788528674.573462:0:17126:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab200/0x892c60dda91c8f0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x892c60dda91c8f15 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528674.573467:0:17126:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788528674.573470:0:17126:0:(mgc_request.c:1180:mgc_blocking_ast()) log lustre-client: stale lock, won't requeue 10000000:01000000:3.0:1788528674.573472:0:17126:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788528674.573527:0:17126:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a90c5a9a000 00010000:00010000:3.0:1788528674.573531:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab200/0x892c60dda91c8f0e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c8f15 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528674.573538:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c14ab200/0x892c60dda91c8f0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c8f15 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528674.573548:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528674.573581:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528674.573584:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788528674.574399:0:21320:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788528674.574409:0:21320:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a90fa8af100 x1875407735584896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528677 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528674.574440:0:21320:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a90faa0a680 x1875407735585152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528682 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528674.574580:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1875407735584896:0@lo:400:kworker.0 00000100:00100000:2.0:1788528674.574633:0:21320:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a90fe693800 x1875407735585408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528687 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528674.574658:0:21320:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788528674.574664:0:21320:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788528674.577659:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1875407735585408:0@lo:400:kworker.0 00000100:00100000:3.0:1788528674.577774:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1875407735585152:0@lo:400:kworker.0 00000100:00080000:2.0:1788528674.581659:0:21320:0:(import.c:65:import_set_state_nolock()) ffff8a90c498e800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788528674.581738:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1875407735585536:0@lo:39:umount.0 00000400:00000100:1.0:1788528674.581807:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875407735585536 offset 0 length 224: 4 00010000:00010000:0.0:1788528674.944726:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528675.968116:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528676.992187:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788528677.054786:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) 463b8984-c30b-4b73-b2f1-81113bd4e10a->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788528677.054796:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788528677.054800:0:469:0:(import.c:65:import_set_state_nolock()) ffff8a90c5a9a000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788528677.054808:0:469:0:(import.c:545:import_select_connection()) MGC192.168.203.138@tcp: connect to NID 0@lo last attempt 541 00000100:00080000:0.0:1788528677.054813:0:469:0:(import.c:630:import_select_connection()) MGC192.168.203.138@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788528677.054820:0:469:0:(import.c:665:import_select_connection()) MGC192.168.203.138@tcp: import ffff8a90c5a9a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1788528677.054858:0:469:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90fe693800 x1875407735585664/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788528677.054987:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:463b8984-c30b-4b73-b2f1-81113bd4e10a:3636:1875407735585664:0@lo:250:kworker.0 00000100:00100000:1.0:1788528677.055071:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528677.055207:0:20804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735585664 00000100:00100000:2.0:1788528677.055215:0:20804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735585664 00000100:00100000:2.0:1788528677.055258:0:20804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788528677.055266:0:20804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c68f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3636:x1875407735585664:12345-0@lo:250:kworker.0 00010000:00000400:2.0:1788528677.055291:0:20804:0:(ldlm_lib.c:1248:target_handle_connect()) MGS: refusing connection from 0@lo: this is an MGS follower, which only serves clients that support it: rc = -19 00000100:00100000:2.0:1788528677.102129:0:20804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c68f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3636:x1875407735585664:12345-0@lo:250:kworker.0 Request processed in 46852us (47047us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788528677.102145:0:20804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788528677.102542:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90c5a9a000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788528677.102589:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-19) 00000100:00100000:0.0:1788528677.102595:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:463b8984-c30b-4b73-b2f1-81113bd4e10a:3636:1875407735585664:0@lo:250:kworker.0 00010000:00010000:0.0:1788528678.014916:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528679.038810:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528680.066340:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528681.088072:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528682.110773:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788528682.176052:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 463b8984-c30b-4b73-b2f1-81113bd4e10a->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788528682.176075:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788528682.176079:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a90c5a9a000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788528682.176125:0:8:0:(import.c:545:import_select_connection()) MGC192.168.203.138@tcp: connect to NID 0@lo last attempt 546 00000100:00080000:3.0:1788528682.176131:0:8:0:(import.c:630:import_select_connection()) MGC192.168.203.138@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788528682.176141:0:8:0:(import.c:665:import_select_connection()) MGC192.168.203.138@tcp: import ffff8a90c5a9a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1788528682.176188:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90fa8afb80 x1875407735585792/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788528682.176623:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:463b8984-c30b-4b73-b2f1-81113bd4e10a:3636:1875407735585792:0@lo:250:kworker.0 00000100:00100000:0.0:1788528682.176725:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528682.176864:0:20805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735585792 00000100:00100000:3.0:1788528682.176873:0:20805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735585792 00000100:00100000:3.0:1788528682.176960:0:20805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788528682.176970:0:20805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f8e20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3636:x1875407735585792:12345-0@lo:250:kworker.0 00010000:00000400:3.0:1788528682.176992:0:20805:0:(ldlm_lib.c:1248:target_handle_connect()) MGS: refusing connection from 0@lo: this is an MGS follower, which only serves clients that support it: rc = -19 00000100:00100000:3.0:1788528682.177065:0:20805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f8e20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3636:x1875407735585792:12345-0@lo:250:kworker.0 Request processed in 87us (331us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788528682.177074:0:20805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788528682.177174:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90c5a9a000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788528682.177181:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-19) 00000100:00100000:1.0:1788528682.177185:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:463b8984-c30b-4b73-b2f1-81113bd4e10a:3636:1875407735585792:0@lo:250:kworker.0 00010000:00010000:3.0:1788528683.137748:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528684.159224:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528684.222895:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788528674/real 1788528674] req@ffff8a90faa08e00 x1875407735585536/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788528684 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528684.222937:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a90faa08e00 x1875407735585536/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788528684 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788528684.222987:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90c498e800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788528684.223012:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1875407735585536:0@lo:39:umount.0 00000100:00080000:2.0:1788528684.223151:0:21320:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788528684.223158:0:21320:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788528684.223164:0:21320:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788528684.224604:0:21320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c784ec00/0x892c60dda91c8ee4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8eeb expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528684.224627:0:21320:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c784ec00/0x892c60dda91c8ee4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8eeb expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528684.224635:0:21320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c784ec00/0x892c60dda91c8ee4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c8eeb expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528684.224643:0:21320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8a90c784ec00/0x892c60dda91c8ee4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c8eeb expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528684.224677:0:21320:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788528684.224702:0:21320:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.203.138@tcp: clear lustre-OST0001 00010000:00010000:2.0:1788528684.224727:0:21320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c6c82600/0x892c60dda91c90dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c90e3 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528684.224735:0:21320:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c6c82600/0x892c60dda91c90dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c90e3 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528684.225893:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788528684.225907:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c784ec00/0x892c60dda91c8ee4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c8eeb expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528684.225980:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c784ec00 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:3.0:1788528684.225985:0:17125:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c784ec00/0x892c60dda91c8ee4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c8eeb expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528684.225996:0:17125:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c784ec00/0x892c60dda91c8ee4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x892c60dda91c8eeb expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788528684.226004:0:17125:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c784ec00/0x892c60dda91c8ee4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x892c60dda91c8eeb expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528684.226010:0:17125:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788528684.226030:0:17125:0:(mgc_request.c:1180:mgc_blocking_ast()) log lustre-OST0001: stale lock, won't requeue 00010000:00010000:3.0:1788528684.226048:0:17125:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a90c5a9a000 00010000:00010000:3.0:1788528684.226052:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c784ec00/0x892c60dda91c8ee4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c8eeb expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528684.226060:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c784ec00/0x892c60dda91c8ee4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c8eeb expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528684.226257:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528684.226259:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528684.226261:0:17125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528684.226460:0:21320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c6c82600/0x892c60dda91c90dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c90e3 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528684.226474:0:21320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8a90c6c82600/0x892c60dda91c90dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c90e3 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528684.226504:0:21320:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788528684.226524:0:21320:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.203.138@tcp: clear params 00010000:00010000:2.0:1788528684.226532:0:21320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c784e000/0x892c60dda91c8ed6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c8edd expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528684.226541:0:21320:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c784e000/0x892c60dda91c8ed6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c8edd expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528684.226548:0:21320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c784e000/0x892c60dda91c8ed6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c8edd expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528684.226736:0:21320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8a90c784e000/0x892c60dda91c8ed6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x892c60dda91c8edd expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528684.227015:0:21320:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788528684.227029:0:21320:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.203.138@tcp: clear lustre-sptlrpc 10000000:01000000:2.0:1788528684.227034:0:21320:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:2.0:1788528684.227082:0:21320:0:(mgc_request.c:650:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788528684.227116:0:21320:0:(tgt_mount.c:2175:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788528684.227132:0:21320:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788528684.227138:0:21320:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788528684.227146:0:21320:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788528684.227151:0:21320:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff8a90fa60e600) has no exports 00000020:00080000:2.0:1788528684.227184:0:21320:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff8a90fa60e600) has no exports 00010000:00010000:3.0:1788528684.230315:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788528684.230335:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c6c82600/0x892c60dda91c90dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c90e3 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528684.230350:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c6c82600 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:3.0:1788528684.230356:0:17126:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c6c82600/0x892c60dda91c90dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c90e3 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528684.230368:0:17126:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c6c82600/0x892c60dda91c90dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x892c60dda91c90e3 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788528684.230378:0:17126:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c6c82600/0x892c60dda91c90dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x892c60dda91c90e3 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528684.230384:0:17126:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788528684.230386:0:17126:0:(mgc_request.c:1180:mgc_blocking_ast()) log params: stale lock, won't requeue 10000000:01000000:3.0:1788528684.230391:0:17126:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788528684.230599:0:19476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528684.230607:0:19476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c784e000/0x892c60dda91c8ed6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c8edd expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528684.230615:0:19476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c784e000 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:0.0:1788528684.230618:0:19476:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c784e000/0x892c60dda91c8ed6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x892c60dda91c8edd expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528684.230648:0:19476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c784e000/0x892c60dda91c8ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x892c60dda91c8edd expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788528684.230655:0:19476:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c784e000/0x892c60dda91c8ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x892c60dda91c8edd expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528684.230660:0:19476:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788528684.230662:0:19476:0:(mgc_request.c:1180:mgc_blocking_ast()) log lustre-sptlrpc: stale lock, won't requeue 10000000:01000000:0.0:1788528684.230665:0:19476:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788528684.230704:0:19476:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a90c5a9a000 00010000:00010000:0.0:1788528684.230709:0:19476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c784e000/0x892c60dda91c8ed6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c8edd expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528684.230716:0:19476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c784e000/0x892c60dda91c8ed6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c8edd expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528684.230738:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528684.230740:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528684.230742:0:19476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528684.230797:0:17126:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a90c5a9a000 00010000:00010000:3.0:1788528684.230803:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c6c82600/0x892c60dda91c90dc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c90e3 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528684.230831:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c6c82600/0x892c60dda91c90dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c90e3 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528684.230845:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528684.230846:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528684.230848:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788528684.233249:0:21320:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a90f8f38180 - data ffff8a90d22dd000/ffff8a8fc308cc00 00000020:01000000:2.0:1788528684.233455:0:21320:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a8fc241f6c0 - data ffff8a90f0c8bd80/ffff8a8fc47a4800 00100000:10000000:2.0:1788528684.245048:0:21320:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788528684.261098:0:21320:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8ef9 00000020:00000080:1.0:1788528684.261111:0:21320:0:(genops.c:885:class_export_put()) final put ffff8a8fc3d1b000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1788528684.261141:0:21320:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8a90c81b5800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788528684.261146:0:21320:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8a90c81b5800 3 00000020:01000004:1.0:1788528684.261150:0:21320:0:(tgt_mount.c:134:server_deregister_mount()) deregister mount ffff8a90c81b5800 from lustre-OST0001 00000020:00000080:2.0:1788528684.261165:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc3d1b000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788528684.261184:0:21320:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788528684.261198:0:21320:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1788528684.261202:0:21320:0:(genops.c:885:class_export_put()) final put ffff8a8fc3d19000/lustre-OST0001_UUID 00000020:00000080:1.0:1788528684.261204:0:21320:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc3d19000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1788528684.261214:0:21320:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1788528684.261355:0:21320:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 463b8984-c30b-4b73-b2f1-81113bd4e10a->MGS 00010000:00010000:1.0:1788528684.261378:0:21320:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a9101851c00/0x892c60dda91c8c21 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x892c60dda91c8c28 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788528684.261392:0:21320:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a9101851c00/0x892c60dda91c8c21 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x892c60dda91c8c28 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528684.261397:0:21320:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1788528684.261400:0:21320:0:(mgc_request.c:1197:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1788528684.261404:0:21320:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1788528684.261466:0:21320:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a90c5a9a000 00010000:00010000:1.0:1788528684.261470:0:21320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a9101851c00/0x892c60dda91c8c21 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x892c60dda91c8c28 expref: -99 pid: 17869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788528684.261494:0:21320:0:(import.c:65:import_set_state_nolock()) ffff8a90c5a9a000 MGS: changing import state from DISCONN to CLOSED 10000000:01000000:1.0:1788528684.261498:0:21320:0:(mgc_request.c:1414:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788528684.261501:0:21320:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788528684.261514:0:21320:0:(mgc_request.c:1414:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788528684.261519:0:21320:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788528684.261522:0:21320:0:(mgc_request.c:1414:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788528684.261525:0:21320:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788528684.261527:0:21320:0:(mgc_request.c:1414:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788528684.261534:0:21320:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8aed 00000020:00000080:1.0:1788528684.261539:0:21320:0:(genops.c:885:class_export_put()) final put ffff8a8fc4778800/463b8984-c30b-4b73-b2f1-81113bd4e10a 00000020:01000000:1.0:1788528684.261678:0:21320:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.203.138@tcp (flags='') 00000020:00000080:1.0:1788528684.261684:0:21320:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788528684.261690:0:21320:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.138@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788528684.261699:0:21320:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8a90ce96b300) has no exports 00000020:00000080:2.0:1788528684.261719:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc4778800/463b8984-c30b-4b73-b2f1-81113bd4e10a for MGC192.168.203.138@tcp 10000000:01000000:0.0:1788528684.262002:0:17134:0:(mgc_request.c:928:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1788528684.262593:0:21320:0:(obd_class.h:688:obd_cleanup_client_import()) MGC192.168.203.138@tcp: client import never connected 00000100:00080000:1.0:1788528684.262599:0:21320:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788528684.262602:0:21320:0:(mgc_request.c:1414:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788528684.262606:0:21320:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788528684.262608:0:21320:0:(mgc_request.c:1414:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788528684.262668:0:21320:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788528684.262677:0:21320:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.138@tcp (uuid 463b8984-c30b-4b73-b2f1-81113bd4e10a) 00000020:01000004:1.0:1788528684.262686:0:21320:0:(tgt_mount.c:284:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788528684.262690:0:21320:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788528684.262696:0:21320:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788528684.262699:0:21320:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788528684.262702:0:21320:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8a90ce96e600) has no exports 00000020:00080000:1.0:1788528684.262708:0:21320:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8a90ce96e600) has no exports 00000020:00000080:2.0:1788528684.262782:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a90c5a9a000 for MGC192.168.203.138@tcp 00000020:00000080:2.0:1788528684.262792:0:8:0:(genops.c:885:class_export_put()) final put ffff8a90c5a9c800/463b8984-c30b-4b73-b2f1-81113bd4e10a 00000020:00000080:2.0:1788528684.262794:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90c5a9c800/463b8984-c30b-4b73-b2f1-81113bd4e10a for MGC192.168.203.138@tcp 00000020:01000000:2.0:1788528684.262800:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.138@tcp (463b8984-c30b-4b73-b2f1-81113bd4e10a) 00000100:00100000:2.0:1788528684.263180:0:20805:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8a90fa9a9600:20805] 1 exiting: rc = 0 00000100:00100000:0.0:1788528684.264139:0:20806:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8a90fa9a9c00:20806] 2 exiting: rc = 0 00000100:00100000:0.0:1788528684.264269:0:20804:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8a8fc1c95000:20804] 0 exiting: rc = 1 00000100:00100000:1.0:1788528684.265515:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.265529:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.265534:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266026:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266038:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266045:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266051:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266060:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266068:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266074:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266081:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266112:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266120:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266127:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266133:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266139:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266146:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266154:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266160:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266168:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266178:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266186:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266192:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266198:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266203:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266216:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266222:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266228:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266234:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266241:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266247:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266253:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266259:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266265:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266272:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266278:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266284:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266291:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266298:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266305:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266311:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266317:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266323:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266329:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266336:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266342:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266356:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266362:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266367:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266373:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266378:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266383:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266389:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266395:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266401:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266406:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266411:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266416:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266421:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266427:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266431:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266437:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.266441:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.267511:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788528684.268739:0:21320:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c9391 00000020:00000080:1.0:1788528684.268756:0:21320:0:(genops.c:885:class_export_put()) final put ffff8a90c68c1000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1788528684.268770:0:21320:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8a90c81b5800 from MGS, refs=2 00000020:01000004:1.0:1788528684.268774:0:21320:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8a90c81b5800 2 00000020:01000004:1.0:1788528684.268778:0:21320:0:(tgt_mount.c:134:server_deregister_mount()) deregister mount ffff8a90c81b5800 from MGS 00000020:00000080:1.0:1788528684.268804:0:21320:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788528684.268814:0:21320:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788528684.268816:0:21320:0:(genops.c:885:class_export_put()) final put ffff8a90c68c5800/MGS 00000020:00000080:1.0:1788528684.268820:0:21320:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90c68c5800/MGS for MGS 00000020:01000000:1.0:1788528684.268829:0:21320:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788528684.269272:0:21320:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788528684.269280:0:21320:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788528684.269289:0:21320:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00000080:2.0:1788528684.269290:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90c68c1000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00080000:1.0:1788528684.269297:0:21320:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8a90c7d52000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788528684.269305:0:21320:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff8a90fa609980) has exports, disconnecting them 00000020:00080000:1.0:1788528684.269312:0:21320:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8a90c7d52000), last request at 1788528604 00000020:00000080:1.0:1788528684.269330:0:21320:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8f23 00000020:00080000:1.0:1788528684.269345:0:21320:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a90c7d52000): rc 0 00000020:00000080:1.0:1788528684.269350:0:21320:0:(genops.c:885:class_export_put()) final put ffff8a90c7d52000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788528684.270714:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90c7d52000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788528684.272868:0:21320:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788528684.272879:0:21320:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788528684.272885:0:21320:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788528684.272894:0:21320:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788528684.273137:0:21320:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788528684.273149:0:21320:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1788528684.273158:0:21320:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788528684.273181:0:21320:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788528684.273187:0:21320:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788528684.273196:0:21320:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8a90d96b4000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788528684.273205:0:21320:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff8a90fb079980) has exports, disconnecting them 00000020:00080000:0.0:1788528684.273210:0:21320:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8a90d96b4000), last request at 1788528605 00000020:00000080:0.0:1788528684.273215:0:21320:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8f38 00000020:00080000:0.0:1788528684.273234:0:21320:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a90d96b4000): rc 0 00000020:00000080:0.0:1788528684.273242:0:21320:0:(genops.c:885:class_export_put()) final put ffff8a90d96b4000/lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1788528684.273467:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a8fc3144000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788528684.273476:0:8:0:(genops.c:885:class_export_put()) final put ffff8a8fc3146800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1788528684.273479:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc3146800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1788528684.273487:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1788528684.273592:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90d96b4000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1788528684.282696:0:21320:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788528684.282709:0:21320:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788528684.282715:0:21320:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788528684.282725:0:21320:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788528684.282761:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a90c498e800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1788528684.284569:0:17125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1788528684.287132:0:19476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1788528684.288682:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1788528684.297966:0:17120:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8a8fc1cec200:17120] 0 exiting: rc = 1 00000100:00100000:1.0:1788528684.300044:0:17121:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8a8fc266ca00:17121] 1 exiting: rc = 0 00000100:00100000:2.0:1788528684.307544:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.308797:0:17124:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8a90f8d71000:17124] 2 exiting: rc = 0 00000100:00100000:2.0:1788528684.308926:0:17122:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8a8fc266dc00:17122] 0 exiting: rc = 1 00000100:00100000:0.0:1788528684.309139:0:17123:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8a8fc266ce00:17123] 1 exiting: rc = 0 00000100:00100000:1.0:1788528684.309796:0:20625:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8a8fc2541800:20625] 3 exiting: rc = 0 00000100:00100000:2.0:1788528684.310102:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310111:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310118:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310124:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310131:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310138:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310144:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310149:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310154:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310162:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310169:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310176:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310183:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310190:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310198:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310209:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310215:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310227:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310234:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310240:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310245:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310250:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310257:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310263:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310269:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310275:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310281:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310288:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310309:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310315:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310321:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310327:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310332:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310338:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310343:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310349:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310354:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310360:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310366:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310373:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310378:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310384:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310389:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310395:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310401:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310407:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310413:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310419:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310425:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310431:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310437:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310451:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310457:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310463:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310469:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310474:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310481:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310486:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310493:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310498:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310503:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310508:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310513:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.310527:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788528684.319090:0:21320:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788528684.319110:0:21320:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1788528684.319118:0:21320:0:(genops.c:885:class_export_put()) final put ffff8a8fc3c50000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1788528684.319124:0:21320:0:(genops.c:844:class_export_destroy()) destroying export ffff8a8fc3c50000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1788528684.319137:0:21320:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1788528684.319240:0:21320:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8a90c81b5800 1 00000020:00000080:2.0:1788528684.319248:0:21320:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x892c60dda91c8ecf 00000020:00000080:2.0:1788528684.319257:0:21320:0:(genops.c:885:class_export_put()) final put ffff8a90d00cb800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788528684.319272:0:21320:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788528684.319288:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90d00cb800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788528684.319303:0:21320:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788528684.319308:0:21320:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788528684.319313:0:21320:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff8a90fa608000) has no exports 00000020:00000080:2.0:1788528684.434413:0:21320:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788528684.434434:0:21320:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788528684.434451:0:21320:0:(genops.c:885:class_export_put()) final put ffff8a90c81b1000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788528684.434457:0:21320:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90c81b1000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788528684.434472:0:21320:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788528684.435259:0:21320:0:(obd_mount.c:670:lustre_free_lsi()) Freeing lsi ffff8a90c81b6800 00000020:01000000:2.0:1788528684.435296:0:21320:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788528684.435302:0:21320:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788528684.435308:0:21320:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788528684.435313:0:21320:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8a90f7dee600) has no exports 00000020:00000080:2.0:1788528684.435342:0:21320:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788528684.435350:0:21320:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788528684.435354:0:21320:0:(genops.c:885:class_export_put()) final put ffff8a90f8f4e800/OSS_uuid 00000020:00000080:2.0:1788528684.435358:0:21320:0:(genops.c:844:class_export_destroy()) destroying export ffff8a90f8f4e800/OSS_uuid for OSS 00000020:01000000:2.0:1788528684.435363:0:21320:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1788528684.435610:0:17133:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788528684.436411:0:18643:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8a90f6f60200:18643] 0 exiting: rc = 1 00000100:00100000:1.0:1788528684.436718:0:18644:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8a8fc341b400:18644] 1 exiting: rc = 0 00000100:00100000:1.0:1788528684.436813:0:18646:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8a90f5ba8000:18646] 2 exiting: rc = 0 00000100:00100000:3.0:1788528684.437046:0:19172:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8a8fc1dea200:19172] 3 exiting: rc = 0 00000100:00100000:2.0:1788528684.437305:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437318:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437324:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437351:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437357:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437363:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437368:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437373:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437379:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437386:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437392:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437398:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437404:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437410:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437416:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437422:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437428:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437433:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437440:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437458:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437463:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437468:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437473:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437478:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437484:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437494:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437500:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437506:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437511:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437517:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437523:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437528:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437534:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437539:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437727:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437742:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437749:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437755:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437768:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437774:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437781:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437789:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437797:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437804:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437812:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437817:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437823:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437829:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437836:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437842:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437854:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437863:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437869:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437874:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437880:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437886:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437892:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437897:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437904:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437910:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437916:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437921:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437928:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.437939:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.440123:0:18648:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8a8fc34b7c00:18648] 1 exiting: rc = 0 00000100:00100000:3.0:1788528684.440408:0:18647:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8a8fc34b7400:18647] 0 exiting: rc = 1 00000100:00100000:1.0:1788528684.440826:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.440836:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.440841:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.440847:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.440852:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.440858:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.440863:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.440869:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.440875:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.440881:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.440887:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.440894:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.440902:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.440909:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.440915:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.440924:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.440931:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.440942:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.440950:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.440958:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.440969:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.440979:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.440991:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.441001:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.441011:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.441022:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.441048:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.441056:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.441065:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.441075:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.441086:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.441096:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.441103:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.441110:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.441117:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.441126:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.441135:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.441143:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.441152:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.441162:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.441171:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.441181:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.441191:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.441198:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.441206:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.441212:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.441218:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.441223:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.441230:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.441236:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.441242:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.441249:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.441256:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.441262:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.441268:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.441274:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.441281:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.441288:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.441296:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.441306:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.441315:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.441331:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.441342:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.441354:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.442584:0:18650:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8a90c6ca9400:18650] 1 exiting: rc = 0 00000100:00100000:1.0:1788528684.442809:0:18651:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8a90c6ca9600:18651] 2 exiting: rc = 0 00000100:00100000:2.0:1788528684.443063:0:18649:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8a90f5aff000:18649] 0 exiting: rc = 1 00000100:00100000:0.0:1788528684.444918:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.444930:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.444937:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.444943:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.444964:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.444973:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.444982:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.444990:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.444997:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.445003:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.445009:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.445015:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.445022:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.445029:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.445036:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.445042:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.445048:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.445054:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447309:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447342:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447350:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447391:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447416:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447422:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447429:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447436:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447454:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447462:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447468:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447475:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447481:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447488:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447497:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447504:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447510:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447515:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447522:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447529:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447546:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447567:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447575:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447581:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447589:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447596:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447602:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447623:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447630:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447636:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447642:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447659:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447666:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447673:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447679:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447688:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447696:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447703:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447711:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447727:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447734:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447741:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447747:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447754:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447770:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.447779:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788528684.459300:0:18652:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8a8fc2589e00:18652] 0 exiting: rc = 1 00000100:00100000:0.0:1788528684.459302:0:18653:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8a90c6cea400:18653] 1 exiting: rc = 0 00000100:00100000:3.0:1788528684.459527:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.459536:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.459541:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.459547:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.459950:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460025:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460031:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460037:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460042:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460047:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460052:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460057:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460063:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460068:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460073:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460078:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460083:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460089:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460094:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460100:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460107:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460128:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460133:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460138:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460144:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460149:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460223:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460233:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460240:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460246:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460252:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460259:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460265:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460270:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460276:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460281:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460289:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460294:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460299:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460305:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460449:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460458:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460465:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460471:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460478:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460484:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460491:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460499:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460505:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460511:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460517:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460524:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460530:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460535:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460540:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460546:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460740:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460747:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460753:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460862:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460870:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460876:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460883:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788528684.460890:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788528684.463064:0:18654:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8a8fc3264200:18654] 0 exiting: rc = 1 00000100:00100000:1.0:1788528684.465916:0:18655:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8a8fc1d06200:18655] 1 exiting: rc = 0 00000100:00100000:2.0:1788528684.466866:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.466905:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.466916:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.466927:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.466937:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.466946:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.466953:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.466960:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.466985:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.466992:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.466998:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467006:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467012:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467037:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467046:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467054:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467061:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467069:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467076:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467083:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467089:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467095:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467102:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467109:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467116:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467139:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467147:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467155:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467163:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467178:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467184:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467191:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467198:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467205:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467211:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467218:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467226:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467248:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467258:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467264:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467272:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467279:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467286:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467300:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467307:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467314:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467321:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467327:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467334:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467356:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467364:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467371:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467378:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467386:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467396:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467403:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467435:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467458:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467466:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467475:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467483:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467490:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467498:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788528684.467514:0:21320:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1788528684.486140:0:21320:0:(tgt_mount.c:2258:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788528702.369151:0:22084:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788528711.637310:0:22684:0:(obd_mount.c:925:lmd_print()) mount data: 00000020:01000004:0.0:1788528711.637316:0:22684:0:(obd_mount.c:928:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1788528711.637317:0:22684:0:(obd_mount.c:931:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788528711.637432:0:22684:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a90ff704000 00000020:01000004:0.0:1788528711.637448:0:22684:0:(tgt_mount.c:2585:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788528711.637456:0:22684:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788528711.637468:0:22684:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8a90fb078000) 00000020:00000080:0.0:1788528711.637483:0:22684:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788528711.716680:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1788528711.727631:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788528711.729233:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1788528711.730124:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788528711.731244:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788528711.731671:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788528711.731890:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788528711.741018:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788528711.741852:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788528711.742363:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788528711.743358:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788528711.743813:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788528711.743991:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788528711.744549:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788528711.748127:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788528711.748959:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788528711.755856:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1788528711.756971:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788528711.757752:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788528711.758045:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1788528711.759139:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1788528711.762061:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788528711.762487:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788528711.762809:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788528711.763745:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788528711.770178:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788528711.772057:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788528711.772546:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1788528711.772906:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1788528711.774198:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1788528711.774541:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788528711.776141:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1788528711.776886:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788528711.777413:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788528711.778460:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788528711.781667:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788528711.782283:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788528711.783534:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788528711.784402:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788528711.784779:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788528711.784978:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788528711.785236:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788528711.786460:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788528711.787097:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788528711.794340:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788528711.794831:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788528711.795048:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1788528711.807409:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1788528711.807954:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1788528711.808190:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1788528711.808737:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1788528711.808984:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1788528711.809221:0:22684:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:2.0:1788528711.810173:0:22684:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788528711.810404:0:22684:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788528711.810411:0:22684:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788528711.810422:0:22684:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x892c60dda91c939f 00000020:01000004:2.0:1788528711.810429:0:22684:0:(tgt_mount.c:2670:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788528711.810434:0:22684:0:(tgt_mount.c:234:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788528711.810438:0:22684:0:(tgt_mount.c:115:server_register_mount()) register mount ffff8a90ff704000 from MGS 00000020:01000004:2.0:1788528711.810441:0:22684:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788528711.810451:0:22684:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8a90f7dee600) 00000020:00000080:2.0:1788528711.810460:0:22684:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788528711.810530:0:22684:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8a90ff704000 from MGS, refs=2 00080000:01000000:2.0:1788528711.810535:0:22684:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788528711.810540:0:22684:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x892c60dda91c93ad 00000100:00100000:3.0:1788528711.816366:0:22684:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788528711.816527:0:22684:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788528711.816533:0:22684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788528711.817168:0:22684:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788528711.817175:0:22684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788528711.817843:0:22684:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788528711.818000:0:22684:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788528711.818005:0:22684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788528711.822850:0:22684:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788528711.822864:0:22684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788528711.825399:0:22684:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788528711.825411:0:22684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788528711.832207:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528711.832212:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528711.832214:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528711.832492:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528711.832495:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528711.832497:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528711.832989:0:22684:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788528711.842870:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788528711.858184:0:22684:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788528711.866613:0:22697:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788528711.866639:0:22684:0:(mgs_nids.c:671:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788528711.866692:0:22684:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788528711.870323:0:22684:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788528711.870962:0:22684:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788528711.871139:0:22684:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788528711.871146:0:22684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788528711.875615:0:22684:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788528711.875629:0:22684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788528711.878694:0:22684:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788528711.878706:0:22684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:1.0:1788528711.883774:0:22701:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:0.0:1788528711.883790:0:22684:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788528711.883814:0:22684:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.138@tcp' 00000020:01000004:0.0:1788528711.883816:0:22684:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788528711.883846:0:22684:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.138@tcp (typ=mgc) 00000020:00000080:0.0:1788528711.883858:0:22684:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.138@tcp (ffff8a90fb07cc80) 00000020:00000080:0.0:1788528711.883876:0:22684:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788528711.884008:0:22684:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a8fc4bb2800@MGC192.168.203.138@tcp: add connection 192.168.203.138@tcp at head 00010000:00010000:0.0:1788528711.884156:0:22684:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.138@tcp-0 is initialized 00000040:01000000:0.0:1788528711.884162:0:22684:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 1 is initialized 10000000:01000000:1.0:1788528711.902288:0:22702:0:(mgc_request.c:839:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788528711.903383:0:22684:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.138@tcp (uuid 07f6b94a-1259-41bf-8282-a67e1c8aef03) 00000020:00000080:0.0:1788528711.903410:0:22684:0:(genops.c:1385:class_connect()) connect: client 07f6b94a-1259-41bf-8282-a67e1c8aef03, cookie 0x892c60dda91c93bb 00000100:00080000:0.0:1788528711.903422:0:22684:0:(import.c:545:import_select_connection()) MGC192.168.203.138@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788528711.903428:0:22684:0:(import.c:665:import_select_connection()) MGC192.168.203.138@tcp: import ffff8a8fc4bb2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1788528711.903463:0:22684:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90fe693800 x1875407735585920/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788528711.903496:0:22684:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 07f6b94a-1259-41bf-8282-a67e1c8aef03->MGS 00000020:01000004:0.0:1788528711.903516:0:22684:0:(tgt_mount.c:1882:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788528711.903520:0:22684:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788528711.903534:0:22684:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8a90fb079980) 00000020:00000080:0.0:1788528711.903545:0:22684:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788528711.903572:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:07f6b94a-1259-41bf-8282-a67e1c8aef03:3636:1875407735585920:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788528711.903651:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528711.906353:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735585920 00000100:00100000:2.0:1788528711.906367:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735585920 00000100:00100000:2.0:1788528711.906417:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788528711.906425:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3636:x1875407735585920:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788528711.906452:0:22698:0:(ldlm_lib.c:1458:target_handle_connect()) MGS: connection from 07f6b94a-1259-41bf-8282-a67e1c8aef03@0@lo t0 exp 0000000000000000 cur 581 last 0 00000020:00000080:2.0:1788528711.906480:0:22698:0:(genops.c:1385:class_connect()) connect: client 07f6b94a-1259-41bf-8282-a67e1c8aef03, cookie 0x892c60dda91c93c9 00000100:00080000:2.0:1788528711.906634:0:22698:0:(import.c:65:import_set_state_nolock()) ffff8a90ff712800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788528711.906720:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+5:3636:x1875407735585920:12345-0@lo:250:mount.lustre.0 Request processed in 294us (3068us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528711.906727:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788528711.906781:0:3636:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.138@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788528711.906790:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.138@tcp: connect to target with instance 0 00000100:00080000:2.0:1788528711.906798:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.138@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788528711.906803:0:3636:0:(mgc_request.c:1414:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788528711.906806:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc4bb2800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788528711.906808:0:3636:0:(mgc_request.c:1414:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788528711.906815:0:3636:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788528711.906819:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:07f6b94a-1259-41bf-8282-a67e1c8aef03:3636:1875407735585920:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788528711.932996:0:22684:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788528711.934390:0:22684:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788528711.934399:0:22684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788528711.943102:0:22684:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788528711.943114:0:22684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788528711.943760:0:22684:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788528711.943767:0:22684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788528711.944775:0:22684:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788528711.944974:0:22684:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788528711.944981:0:22684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788528711.947200:0:22684:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788528711.947217:0:22684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788528712.017349:0:22684:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788528712.017593:0:22684:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788528712.017737:0:22684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788528712.019276:0:22684:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788528712.019287:0:22684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788528712.020081:0:22684:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788528712.020689:0:22684:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788528712.020695:0:22684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788528712.037744:0:22684:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788528712.037766:0:22684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788528712.042521:0:22684:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788528712.043465:0:22684:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788528712.043473:0:22684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788528712.046123:0:22684:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788528712.046135:0:22684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788528712.048214:0:22684:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788528712.048410:0:22684:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788528712.048416:0:22684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788528712.051218:0:22684:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788528712.051230:0:22684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788528712.089205:0:22684:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788528712.090996:0:22684:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788528712.091007:0:22684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788528712.110262:0:22684:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788528712.110278:0:22684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788528712.112001:0:22684:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788528712.112014:0:22684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788528712.117451:0:22684:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788528712.117498:0:22684:0:(tgt_mount.c:1482:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.138@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788528712.117504:0:22684:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788528712.117506:0:22684:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788528712.117507:0:22684:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788528712.117508:0:22684:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788528712.117509:0:22684:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788528712.117510:0:22684:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788528712.117512:0:22684:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788528712.117513:0:22684:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788528712.117515:0:22684:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788528712.117516:0:22684:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788528712.117519:0:22684:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788528712.117522:0:22684:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788528712.117523:0:22684:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788528712.117524:0:22684:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788528712.117526:0:22684:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788528712.117527:0:22684:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788528712.117528:0:22684:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788528712.117529:0:22684:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788528712.117530:0:22684:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788528712.117531:0:22684:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788528712.117532:0:22684:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788528712.118439:0:22684:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788528712.118469:0:22684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe693b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:22684:1875407735586048:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788528712.118540:0:22684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528712.118959:0:22684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c3de2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788528712.119489:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735586048 00000100:00100000:2.0:1788528712.119498:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735586048 00000100:00100000:2.0:1788528712.119594:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788528712.119771:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+5:22684:x1875407735586048:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788528712.119815:0:22700:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788528712.119818:0:22700:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788528712.119834:0:22700:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788528712.120483:0:22721:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788528712.122758:0:22700:0:(mgs_nids.c:671:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:0.0:1788528712.133647:0:22722:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788528712.133654:0:22722:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1788528712.133657:0:22722:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788528712.133660:0:22722:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788528712.135804:0:22722:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1788528712.136043:0:22700:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788528712.136054:0:22700:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788528712.139149:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+5:22684:x1875407735586048:12345-0@lo:253:mount.lustre.0 Request processed in 19372us (20598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528712.139168:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788528712.139362:0:22684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe693b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:22684:1875407735586048:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788528712.139388:0:22684:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788528712.139391:0:22684:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788528712.139393:0:22684:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788528712.139400:0:22684:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788528712.139401:0:22684:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788528712.139402:0:22684:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788528712.139404:0:22684:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788528712.139405:0:22684:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788528712.139407:0:22684:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788528712.139409:0:22684:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788528712.139410:0:22684:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788528712.139428:0:22684:0:(tgt_mount.c:115:server_register_mount()) register mount ffff8a90ff704000 from lustre-MDT0000 10000000:01000000:0.0:1788528712.139462:0:22684:0:(mgc_request.c:2207:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788528712.139465:0:22684:0:(mgc_request.c:423:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788528712.139468:0:22684:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8a90ff704000 10000000:01000000:0.0:1788528712.139474:0:22684:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788528712.139500:0:22684:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-sptlrpc-ffff8a90ff704000 from 1 10000000:01000000:0.0:1788528712.139503:0:22684:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788528712.139539:0:22684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101850600/0x892c60dda91c93d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528712.139549:0:22684:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a9101850600/0x892c60dda91c93d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528712.139608:0:22684:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a9101850600/0x892c60dda91c93d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528712.139637:0:22684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe693b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:22684:1875407735586176:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788528712.139672:0:22684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528712.139707:0:22684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c3de2600 going to sleep for 11 seconds 00000100:00100000:3.0:1788528712.140211:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735586176 00000100:00100000:3.0:1788528712.140217:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735586176 00000100:00100000:3.0:1788528712.140267:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788528712.140276:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+5:22684:x1875407735586176:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788528712.140288:0:22699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528712.140304:0:22699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c6c83a00/0x892c60dda91c93d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c93d0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528712.140327:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c6c83a00/0x892c60dda91c93d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c93d0 expref: 6 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528712.140337:0:22699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c6c83a00/0x892c60dda91c93d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c93d0 expref: 6 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528712.140346:0:22699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c6c83a00, rc 0) 00000100:00100000:3.0:1788528712.140399:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+6:22684:x1875407735586176:12345-0@lo:101:mount.lustre.0 Request processed in 124us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528712.140406:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788528712.140491:0:22684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe693b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:22684:1875407735586176:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788528712.140515:0:22684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a9101850600/0x892c60dda91c93d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c93d7 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528712.140524:0:22684:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a9101850600/0x892c60dda91c93d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c93d7 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528712.140607:0:22684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:22684:1875407735586304:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788528712.140635:0:22684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528712.140656:0:22684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f5906780 going to sleep for 11 seconds 00000100:00100000:3.0:1788528712.140801:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735586304 00000100:00100000:3.0:1788528712.140805:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735586304 00000100:00100000:3.0:1788528712.140837:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788528712.140843:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+6:22684:x1875407735586304:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788528712.140922:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+6:22684:x1875407735586304:12345-0@lo:501:mount.lustre.0 Request processed in 78us (285us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788528712.140928:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788528712.142143:0:22684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:22684:1875407735586304:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788528712.142165:0:22684:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788528712.142179:0:22684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101850600/0x892c60dda91c93d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c93d7 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528712.142187:0:22684:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a9101850600/0x892c60dda91c93d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c93d7 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528712.142195:0:22684:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff8a90ff704000 10000000:01000000:2.0:1788528712.142202:0:22684:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788528712.142230:0:22684:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-barrier-ffff8a90ff704000 10000000:01000000:2.0:1788528712.142233:0:22684:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788528712.142274:0:22684:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-barrier-ffff8a90ff704000 from 1 10000000:01000000:2.0:1788528712.142277:0:22684:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788528712.142306:0:22684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3e00/0x892c60dda91c93de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528712.142313:0:22684:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3e00/0x892c60dda91c93de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528712.142321:0:22684:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3e00/0x892c60dda91c93de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528712.142336:0:22684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:22684:1875407735586432:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788528712.142390:0:22684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528712.142417:0:22684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c5ade300 going to sleep for 11 seconds 00000100:00100000:1.0:1788528712.142623:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735586432 00000100:00100000:1.0:1788528712.142629:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735586432 00000100:00100000:1.0:1788528712.142658:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788528712.142665:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+6:22684:x1875407735586432:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788528712.142676:0:22699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528712.142689:0:22699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c784f800/0x892c60dda91c93e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c93de expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528712.142706:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c784f800/0x892c60dda91c93e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c93de expref: 7 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528712.142715:0:22699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c784f800/0x892c60dda91c93e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c93de expref: 7 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528712.142722:0:22699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c784f800, rc 0) 00000100:00100000:1.0:1788528712.142762:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+7:22684:x1875407735586432:12345-0@lo:101:mount.lustre.0 Request processed in 97us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528712.142768:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788528712.143783:0:22684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:22684:1875407735586432:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788528712.143814:0:22684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3e00/0x892c60dda91c93de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c93e5 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528712.143827:0:22684:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3e00/0x892c60dda91c93de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c93e5 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528712.143843:0:22684:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788528712.143861:0:22684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3e00/0x892c60dda91c93de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c93e5 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528712.143868:0:22684:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3e00/0x892c60dda91c93de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c93e5 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528712.143874:0:22684:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788528712.143880:0:22684:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788528712.143909:0:22684:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-mdtir-ffff8a90ff704000 10000000:01000000:2.0:1788528712.143913:0:22684:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788528712.143941:0:22684:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788528712.143943:0:22684:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788528712.143967:0:22684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2c00/0x892c60dda91c93ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528712.143975:0:22684:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2c00/0x892c60dda91c93ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528712.143982:0:22684:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2c00/0x892c60dda91c93ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528712.143997:0:22684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:22684:1875407735586560:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788528712.144041:0:22684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528712.144079:0:22684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c5ade300 going to sleep for 11 seconds 00000100:00100000:3.0:1788528712.144927:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735586560 00000100:00100000:3.0:1788528712.144935:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735586560 00000100:00100000:3.0:1788528712.144985:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788528712.144993:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+7:22684:x1875407735586560:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788528712.145014:0:22699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528712.145028:0:22699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c6c82600/0x892c60dda91c93f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c93ec expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528712.145048:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c6c82600/0x892c60dda91c93f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c93ec expref: 8 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528712.145057:0:22699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c6c82600/0x892c60dda91c93f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c93ec expref: 8 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528712.145064:0:22699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c6c82600, rc 0) 00000100:00100000:3.0:1788528712.145229:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+8:22684:x1875407735586560:12345-0@lo:101:mount.lustre.0 Request processed in 235us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528712.145235:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788528712.145329:0:22684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:22684:1875407735586560:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788528712.145344:0:22684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2c00/0x892c60dda91c93ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c93f3 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528712.145354:0:22684:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2c00/0x892c60dda91c93ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c93f3 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528712.145416:0:22684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe692300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:22684:1875407735586688:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788528712.145445:0:22684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528712.145473:0:22684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c3de2600 going to sleep for 11 seconds 00000100:00100000:3.0:1788528712.146197:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735586688 00000100:00100000:3.0:1788528712.146203:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735586688 00000100:00100000:3.0:1788528712.146238:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788528712.146245:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+8:22684:x1875407735586688:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788528712.148291:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+9:22684:x1875407735586688:12345-0@lo:501:mount.lustre.0 Request processed in 2040us (2837us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528712.148304:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788528712.149270:0:22684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe692300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:22684:1875407735586688:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788528712.149334:0:22684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe692300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:22684:1875407735586816:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788528712.149394:0:22684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528712.149428:0:22684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c3de2600 going to sleep for 11 seconds 00000100:00100000:3.0:1788528712.150209:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735586816 00000100:00100000:3.0:1788528712.150218:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735586816 00000100:00100000:3.0:1788528712.150276:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788528712.150285:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+9:22684:x1875407735586816:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788528712.158393:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+9:22684:x1875407735586816:12345-0@lo:503:mount.lustre.0 Request processed in 8097us (8987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528712.158429:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788528712.167167:0:22684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe692300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:22684:1875407735586816:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788528712.167999:0:22723:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37adc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07f6b94a-1259-41bf-8282-a67e1c8aef03:22723:1875407735586944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788528712.168074:0:22723:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528712.168124:0:22723:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d162eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788528712.168234:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735586944 00000100:00100000:2.0:1788528712.168241:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735586944 00000100:00100000:2.0:1788528712.168298:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788528712.168306:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+9:22723:x1875407735586944:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788528712.171163:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+9:22723:x1875407735586944:12345-0@lo:502:llog_process_th.0 Request processed in 2847us (3079us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528712.171178:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788528712.171357:0:22723:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37adc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07f6b94a-1259-41bf-8282-a67e1c8aef03:22723:1875407735586944:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788528712.171405:0:22723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788528712.171417:0:22723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528712.171420:0:22723:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788528712.171425:0:22723:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788528712.171428:0:22723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788528712.171443:0:22723:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8a90ce96e600) 00000020:00000080:1.0:1788528712.171462:0:22723:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788528712.171468:0:22723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788528712.171544:0:22723:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788528712.171571:0:22723:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x892c60dda91c9401 00000020:00000080:1.0:1788528712.171795:0:22723:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788528712.171799:0:22723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788528712.171802:0:22723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528712.171804:0:22723:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788528712.171807:0:22723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788528712.171810:0:22723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528712.171812:0:22723:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788528712.171815:0:22723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788528712.171822:0:22723:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8a90ce96cc80) 00000020:00000080:1.0:1788528712.171831:0:22723:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788528712.171834:0:22723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788528712.171836:0:22723:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788528712.171839:0:22723:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788528712.171843:0:22723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788528712.171885:0:22723:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8a90ff704000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788528712.171895:0:22723:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8a90ce969980) 00000020:00000080:1.0:1788528712.171902:0:22723:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788528712.171963:0:22723:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788528712.171973:0:22723:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x892c60dda91c9416 00000020:00000080:1.0:1788528712.172060:0:22723:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788528712.172066:0:22723:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788528712.172069:0:22723:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x892c60dda91c941d 00080000:01000000:1.0:1788528712.172074:0:22723:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788528712.172077:0:22723:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x892c60dda91c9424 00010000:00010000:2.0:1788528712.301320:0:22723:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788528712.302127:0:22723:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:2.0:1788528712.302596:0:22723:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788528712.303083:0:22723:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8a90f7de9980) 00000020:00000080:2.0:1788528712.303099:0:22723:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788528712.304141:0:22723:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788528712.304159:0:22723:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x892c60dda91c9432 00000020:00000080:0.0:1788528712.309410:0:22723:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788528712.315167:0:22723:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x892c60dda91c9439 00000020:00000080:1.0:1788528712.315642:0:22723:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788528712.315654:0:22723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788528712.315661:0:22723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528712.315663:0:22723:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788528712.315666:0:22723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788528712.315670:0:22723:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1788528712.315671:0:22723:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788528712.315673:0:22723:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788528712.315674:0:22723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788528712.315677:0:22723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528712.315678:0:22723:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788528712.315680:0:22723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788528712.315685:0:22723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528712.315686:0:22723:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788528712.315691:0:22723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788528712.315727:0:22723:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788528712.315742:0:22723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788528712.315745:0:22723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528712.315746:0:22723:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788528712.315748:0:22723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788528712.315752:0:22723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528712.315753:0:22723:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788528712.315755:0:22723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788528712.315760:0:22723:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:00000080:1.0:1788528712.315786:0:22723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788528712.315801:0:22723:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8a90ce96b300) 00000020:00000080:1.0:1788528712.315814:0:22723:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788528712.315819:0:22723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788528712.315876:0:22723:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788528712.315881:0:22723:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788528712.315887:0:22723:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x892c60dda91c9447 00010000:00080000:1.0:1788528712.315926:0:22723:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a8fc1d13800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.138@tcp at head 00010000:00010000:1.0:1788528712.317510:0:22723:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1788528712.323363:0:22723:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788528712.325215:0:22723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788528712.325280:0:22723:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788528712.325304:0:22723:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x892c60dda91c944e 00000100:00080000:1.0:1788528712.325314:0:22723:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788528712.325321:0:22723:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a8fc1d13800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1788528712.325356:0:22723:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a8fc37adc00 x1875407735587072/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788528712.325444:0:22723:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1788528712.325528:0:22723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788528712.325533:0:22723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528712.325535:0:22723:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1788528712.325539:0:22723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788528712.325542:0:22723:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1788528712.325543:0:22723:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788528712.325545:0:22723:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788528712.325546:0:22723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788528712.325549:0:22723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528712.325550:0:22723:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788528712.325573:0:22723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788528712.325578:0:22723:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788528712.325582:0:22723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528712.325584:0:22723:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788528712.325587:0:22723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788528712.325591:0:22723:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000100:00100000:3.0:1788528712.325723:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735587072:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788528712.325791:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528712.325885:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735587072 00000100:00100000:1.0:1788528712.325904:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735587072 00000020:01000000:0.0:1788528712.326329:0:22723:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788528712.326334:0:22723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788528712.326349:0:22723:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8a90fb07b300) 00000020:00000080:0.0:1788528712.326364:0:22723:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1788528712.326368:0:22723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788528712.326466:0:22723:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788528712.326473:0:22723:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788528712.326479:0:22723:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x892c60dda91c945c 00010000:00080000:0.0:1788528712.326519:0:22723:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a8fc3d1e000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.138@tcp at head 00000100:00100000:1.0:1788528712.327296:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788528712.327306:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1875407735587072:12345-0@lo:38:llog_process_th.0 00010000:00020000:1.0:1788528712.327323:0:22710:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00010000:0.0:1788528712.329421:0:22723:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1788528712.331768:0:22723:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788528712.332028:0:22723:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788528712.339297:0:22723:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788528712.340803:0:22723:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1788528712.352400:0:22723:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:2.0:1788528712.358520:0:22729:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788528712.358529:0:22729:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00100000:1.0:1788528712.363161:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1875407735587072:12345-0@lo:38:llog_process_th.0 Request processed in 35846us (37361us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788528712.363175:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788528712.363429:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1d13800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788528712.363437:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788528712.363449:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735587072:0@lo:38:llog_process_th.0 00000020:00000080:1.0:1788528712.367461:0:22723:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788528712.367475:0:22723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788528712.367518:0:22723:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788528712.367536:0:22723:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x892c60dda91c9463 00000100:00080000:1.0:1788528712.367546:0:22723:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788528712.367591:0:22723:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a8fc3d1e000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1788528712.367637:0:22723:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a8fc37af800 x1875407735587200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788528712.367660:0:22723:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788528712.367727:0:22723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788528712.367731:0:22723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528712.367733:0:22723:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788528712.367736:0:22723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788528712.367739:0:22723:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1788528712.367740:0:22723:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788528712.367742:0:22723:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788528712.367743:0:22723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788528712.367745:0:22723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528712.367746:0:22723:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788528712.367749:0:22723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788528712.367753:0:22723:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788528712.367756:0:22723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528712.367757:0:22723:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788528712.367774:0:22723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788528712.367777:0:22723:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:01000000:1.0:1788528712.367800:0:22723:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788528712.367802:0:22723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788528712.367813:0:22723:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8a90ce968000) 00000020:00000080:1.0:1788528712.367824:0:22723:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1788528712.367828:0:22723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788528712.367893:0:22723:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788528712.367899:0:22723:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:1.0:1788528712.367905:0:22723:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x892c60dda91c9471 00010000:00080000:1.0:1788528712.367936:0:22723:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a8fc1d13000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.138@tcp at head 00010000:00010000:1.0:1788528712.368135:0:22723:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1788528712.368206:0:22723:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788528712.368220:0:22723:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1788528712.369782:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735587200:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788528712.369838:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875407735587200 offset 0 length 520: 4 00000040:00080000:0.0:1788528712.371125:0:22723:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788528712.371417:0:22723:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1788528712.371544:0:22723:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:3.0:1788528712.372106:0:22731:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788528712.372111:0:22731:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788528712.374856:0:22723:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788528712.374870:0:22723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788528712.374915:0:22723:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788528712.374934:0:22723:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x892c60dda91c9478 00000100:00080000:1.0:1788528712.374945:0:22723:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788528712.374952:0:22723:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a8fc1d13000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1788528712.374985:0:22723:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a8fc37afb80 x1875407735587328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788528712.375038:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735587328:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788528712.375090:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875407735587328 offset 0 length 520: 4 00000100:00080000:1.0:1788528712.375318:0:22723:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788528712.375391:0:22723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788528712.375396:0:22723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528712.375398:0:22723:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788528712.375401:0:22723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788528712.375405:0:22723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528712.375406:0:22723:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788528712.375409:0:22723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788528712.375424:0:22723:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788528712.375427:0:22723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788528712.375430:0:22723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528712.375431:0:22723:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788528712.375434:0:22723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788528712.375436:0:22723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528712.375438:0:22723:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788528712.375441:0:22723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788528712.375469:0:22723:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37ace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07f6b94a-1259-41bf-8282-a67e1c8aef03:22723:1875407735587456:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788528712.375518:0:22723:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528712.375534:0:22723:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc3ded180 going to sleep for 11 seconds 00000100:00100000:3.0:1788528712.375833:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735587456 00000100:00100000:3.0:1788528712.375841:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735587456 00000100:00100000:3.0:1788528712.375881:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788528712.375889:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+9:22723:x1875407735587456:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788528712.376423:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+9:22723:x1875407735587456:12345-0@lo:502:llog_process_th.0 Request processed in 533us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528712.376431:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788528712.379905:0:22723:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37ace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07f6b94a-1259-41bf-8282-a67e1c8aef03:22723:1875407735587456:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788528712.379958:0:22723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788528712.379967:0:22723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528712.379969:0:22723:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788528712.379974:0:22723:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1788528712.380228:0:22684:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1788528712.380238:0:22684:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788528712.380292:0:22684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2c00/0x892c60dda91c93ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c93f3 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528712.380303:0:22684:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2c00/0x892c60dda91c93ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c93f3 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528712.380311:0:22684:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-mdtir-ffff8a90ff704000 from 1 10000000:01000000:2.0:1788528712.380314:0:22684:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788528712.380348:0:22684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3600/0x892c60dda91c947f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528712.380382:0:22684:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3600/0x892c60dda91c947f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528712.380392:0:22684:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3600/0x892c60dda91c947f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528712.380413:0:22684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:22684:1875407735587584:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788528712.380483:0:22684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528712.380522:0:22684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90de6c5780 going to sleep for 11 seconds 00000100:00100000:0.0:1788528712.382129:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735587584 00000100:00100000:0.0:1788528712.382142:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735587584 00000100:00100000:0.0:1788528712.382193:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788528712.382203:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+9:22684:x1875407735587584:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788528712.382217:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528712.382234:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9101851200/0x892c60dda91c9486 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c947f expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528712.382268:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9101851200/0x892c60dda91c9486 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c947f expref: 10 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528712.382279:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9101851200/0x892c60dda91c9486 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c947f expref: 10 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528712.382287:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101851200, rc 0) 00000100:00100000:0.0:1788528712.382343:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+10:22684:x1875407735587584:12345-0@lo:101:mount.lustre.0 Request processed in 141us (1858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528712.382349:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788528712.384123:0:22684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:22684:1875407735587584:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788528712.384152:0:22684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3600/0x892c60dda91c947f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9486 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528712.384163:0:22684:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3600/0x892c60dda91c947f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c9486 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528712.385987:0:22684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:22684:1875407735587712:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788528712.386064:0:22684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528712.386116:0:22684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c7d119c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788528712.386141:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735587712 00000100:00100000:3.0:1788528712.386149:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735587712 00000100:00100000:3.0:1788528712.386193:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788528712.386201:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+10:22684:x1875407735587712:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788528712.386222:0:22699:0:(mgs_nids.c:920:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788528712.386228:0:22699:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788528712.386317:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+10:22684:x1875407735587712:12345-0@lo:256:mount.lustre.0 Request processed in 116us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528712.386335:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788528712.388881:0:22684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:22684:1875407735587712:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788528712.389914:0:22684:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788528712.391202:0:22684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3600/0x892c60dda91c947f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9486 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528712.391218:0:22684:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3600/0x892c60dda91c947f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9486 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528712.391905:0:22684:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff8a90ff704000 from 1 10000000:01000000:3.0:1788528712.391911:0:22684:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788528712.391957:0:22684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83800/0x892c60dda91c948d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528712.391965:0:22684:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83800/0x892c60dda91c948d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528712.391975:0:22684:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83800/0x892c60dda91c948d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528712.391999:0:22684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:22684:1875407735587840:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788528712.392063:0:22684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528712.392119:0:22684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c7d119c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788528712.393374:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735587840 00000100:00100000:2.0:1788528712.393387:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735587840 00000100:00100000:2.0:1788528712.393442:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788528712.393466:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+10:22684:x1875407735587840:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788528712.393480:0:22700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528712.393499:0:22700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a8fc26e2400/0x892c60dda91c9494 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c948d expref: -99 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528712.393523:0:22700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a8fc26e2400/0x892c60dda91c9494 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c948d expref: 11 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528712.393534:0:22700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a8fc26e2400/0x892c60dda91c9494 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c948d expref: 11 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528712.393542:0:22700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc26e2400, rc 0) 00000100:00100000:2.0:1788528712.393618:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+11:22684:x1875407735587840:12345-0@lo:101:mount.lustre.0 Request processed in 154us (1555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528712.393625:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788528712.393818:0:22684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:22684:1875407735587840:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788528712.393833:0:22684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83800/0x892c60dda91c948d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9494 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528712.393843:0:22684:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83800/0x892c60dda91c948d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c9494 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528712.393883:0:22684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:22684:1875407735587968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788528712.393913:0:22684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528712.393943:0:22684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c7d119c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788528712.396647:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735587968 00000100:00100000:1.0:1788528712.396662:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735587968 00000100:00100000:1.0:1788528712.396719:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788528712.396729:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+11:22684:x1875407735587968:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788528712.396906:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+11:22684:x1875407735587968:12345-0@lo:501:mount.lustre.0 Request processed in 178us (2991us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528712.396914:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788528712.397119:0:22684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:22684:1875407735587968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788528712.397171:0:22684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:22684:1875407735588096:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788528712.397230:0:22684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528712.397276:0:22684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c7d119c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788528712.397921:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735588096 00000100:00100000:1.0:1788528712.397927:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735588096 00000100:00100000:1.0:1788528712.397959:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788528712.397966:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+11:22684:x1875407735588096:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788528712.398058:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+11:22684:x1875407735588096:12345-0@lo:503:mount.lustre.0 Request processed in 92us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528712.398074:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788528712.398636:0:22684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:22684:1875407735588096:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788528712.405109:0:22733:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa08380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07f6b94a-1259-41bf-8282-a67e1c8aef03:22733:1875407735588224:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788528712.405189:0:22733:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528712.405233:0:22733:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90de6c5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788528712.405292:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735588224 00000100:00100000:3.0:1788528712.405301:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735588224 00000100:00100000:3.0:1788528712.405353:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788528712.405362:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+11:22733:x1875407735588224:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788528712.406154:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+11:22733:x1875407735588224:12345-0@lo:502:llog_process_th.0 Request processed in 790us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528712.406164:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788528712.406273:0:22733:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa08380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07f6b94a-1259-41bf-8282-a67e1c8aef03:22733:1875407735588224:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788528712.406306:0:22733:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788528712.406315:0:22733:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528712.406318:0:22733:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788528712.406325:0:22733:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a90ff704000 00000020:00000080:2.0:1788528712.406328:0:22733:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788528712.406336:0:22733:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788528712.406338:0:22733:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528712.406339:0:22733:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788528712.406341:0:22733:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788528712.406344:0:22733:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528712.406351:0:22733:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788528712.406355:0:22733:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a90ff704000 00000020:00000080:2.0:1788528712.406357:0:22733:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788528712.406425:0:22733:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788528712.406429:0:22733:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528712.406431:0:22733:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788528712.406433:0:22733:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788528712.406436:0:22733:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528712.406437:0:22733:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788528712.406440:0:22733:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a90ff704000 00000020:00000080:2.0:1788528712.406442:0:22733:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788528712.406460:0:22733:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788528712.406463:0:22733:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528712.406464:0:22733:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788528712.406467:0:22733:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788528712.406469:0:22733:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528712.406470:0:22733:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788528712.406473:0:22733:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a90ff704000 00000020:00000080:2.0:1788528712.406475:0:22733:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788528712.406516:0:22733:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa08380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07f6b94a-1259-41bf-8282-a67e1c8aef03:22733:1875407735588352:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788528712.406774:0:22733:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528712.406810:0:22733:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90de6c5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788528712.406861:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735588352 00000100:00100000:1.0:1788528712.406868:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735588352 00000100:00100000:1.0:1788528712.406913:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788528712.406921:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+11:22733:x1875407735588352:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788528712.407017:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+11:22733:x1875407735588352:12345-0@lo:502:llog_process_th.0 Request processed in 97us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528712.407024:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788528712.408405:0:22733:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa08380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07f6b94a-1259-41bf-8282-a67e1c8aef03:22733:1875407735588352:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788528712.408447:0:22733:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788528712.408454:0:22733:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528712.408455:0:22733:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788528712.408460:0:22733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788528712.408834:0:22684:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788528712.408844:0:22684:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788528712.408866:0:22684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83800/0x892c60dda91c948d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9494 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528712.408877:0:22684:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83800/0x892c60dda91c948d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9494 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528712.408931:0:22684:0:(mgc_request.c:2207:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788528712.408934:0:22684:0:(mgc_request.c:423:config_log_add()) add config log lustre-client-ffff8a90ff704000 10000000:01000000:1.0:1788528712.408937:0:22684:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff8a90ff704000 10000000:01000000:1.0:1788528712.408942:0:22684:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788528712.408966:0:22684:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-client-ffff8a90ff704000 from 1 10000000:01000000:1.0:1788528712.408969:0:22684:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788528712.409002:0:22684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c784e800/0x892c60dda91c949b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528712.409010:0:22684:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c784e800/0x892c60dda91c949b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528712.409019:0:22684:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c784e800/0x892c60dda91c949b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528712.409056:0:22684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:22684:1875407735588480:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788528712.409116:0:22684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528712.409147:0:22684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d01b3240 going to sleep for 11 seconds 00000100:00100000:0.0:1788528712.410825:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735588480 00000100:00100000:0.0:1788528712.410846:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735588480 00000100:00100000:0.0:1788528712.410898:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788528712.410906:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+11:22684:x1875407735588480:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788528712.410921:0:22700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528712.410934:0:22700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9101850a00/0x892c60dda91c94a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c949b expref: -99 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528712.410958:0:22700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9101850a00/0x892c60dda91c94a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c949b expref: 12 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528712.410968:0:22700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9101850a00/0x892c60dda91c94a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c949b expref: 12 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528712.410977:0:22700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101850a00, rc 0) 00000100:00100000:0.0:1788528712.411042:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+12:22684:x1875407735588480:12345-0@lo:101:mount.lustre.0 Request processed in 136us (1926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528712.411048:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788528712.411333:0:22684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:22684:1875407735588480:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788528712.411352:0:22684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c784e800/0x892c60dda91c949b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c94a2 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528712.411386:0:22684:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c784e800/0x892c60dda91c949b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c94a2 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528712.411438:0:22684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:22684:1875407735588608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788528712.411472:0:22684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528712.411509:0:22684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90de6c5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788528712.415945:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735588608 00000100:00100000:0.0:1788528712.415960:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735588608 00000100:00100000:0.0:1788528712.416012:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788528712.416024:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+12:22684:x1875407735588608:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788528712.416208:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+12:22684:x1875407735588608:12345-0@lo:501:mount.lustre.0 Request processed in 187us (4735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528712.416216:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788528712.416326:0:22684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:22684:1875407735588608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788528712.416384:0:22684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:22684:1875407735588736:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788528712.416431:0:22684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528712.416522:0:22684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90de6c5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788528712.424800:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735588736 00000100:00100000:0.0:1788528712.424816:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735588736 00000100:00100000:0.0:1788528712.424875:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788528712.424885:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+12:22684:x1875407735588736:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788528712.425044:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+12:22684:x1875407735588736:12345-0@lo:503:mount.lustre.0 Request processed in 160us (8611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528712.425051:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788528712.425183:0:22684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:22684:1875407735588736:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788528712.426087:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe692300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07f6b94a-1259-41bf-8282-a67e1c8aef03:22738:1875407735588864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788528712.426140:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528712.426170:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735588864 00000100:00100000:0.0:1788528712.426175:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735588864 00000100:00100000:0.0:1788528712.426204:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788528712.426211:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+12:22738:x1875407735588864:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788528712.426311:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+12:22738:x1875407735588864:12345-0@lo:502:llog_process_th.0 Request processed in 99us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528712.426318:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788528712.426361:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c81fe0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528712.426386:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe692300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07f6b94a-1259-41bf-8282-a67e1c8aef03:22738:1875407735588864:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788528712.426441:0:22738:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788528712.426456:0:22738:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8a90fb07e600) 00000020:00000080:0.0:1788528712.426475:0:22738:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1788528712.426836:0:22738:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8a90ff704000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788528712.426841:0:22738:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8a90ff704000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788528712.426843:0:22738:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8a90ff704000 4 00010000:00080000:0.0:1788528712.426871:0:22738:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a90c7d56800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.138@tcp at head 00010000:00010000:0.0:1788528712.438270:0:22738:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1788528712.439096:0:22738:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788528712.439141:0:22738:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788528712.439160:0:22738:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x892c60dda91c94b0 00000100:00080000:0.0:1788528712.439171:0:22738:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788528712.439184:0:22738:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8a90c7d56800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1788528712.439219:0:22738:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90fe692300 x1875407735588992/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788528712.439668:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875407735588992:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788528712.439747:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788528712.441533:0:22738:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788528712.445348:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735588992 00000100:00100000:3.0:1788528712.445363:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735588992 00000100:00100000:3.0:1788528712.445404:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788528712.445413:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1875407735588992:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788528712.445500:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1875407735588992:12345-0@lo:38:llog_process_th.0 Request processed in 87us (5753us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788528712.445507:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788528712.450032:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788528712.450047:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90c7d56800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788528712.450055:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788528712.450060:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875407735588992:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788528712.451799:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe692300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07f6b94a-1259-41bf-8282-a67e1c8aef03:22738:1875407735589120:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788528712.451874:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528712.451915:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c81fee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788528712.452196:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735589120 00000100:00100000:3.0:1788528712.452204:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735589120 00000100:00100000:3.0:1788528712.452244:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788528712.452264:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+12:22738:x1875407735589120:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788528712.452385:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+12:22738:x1875407735589120:12345-0@lo:502:llog_process_th.0 Request processed in 123us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528712.452393:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788528712.452695:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe692300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07f6b94a-1259-41bf-8282-a67e1c8aef03:22738:1875407735589120:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788528712.452741:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe692300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07f6b94a-1259-41bf-8282-a67e1c8aef03:22738:1875407735589248:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788528712.452775:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528712.452796:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735589248 00000100:00100000:0.0:1788528712.452800:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735589248 00000100:00100000:0.0:1788528712.453394:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788528712.453403:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+12:22738:x1875407735589248:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788528712.453490:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+12:22738:x1875407735589248:12345-0@lo:502:llog_process_th.0 Request processed in 88us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528712.458228:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d83bef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788528712.458286:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe692300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07f6b94a-1259-41bf-8282-a67e1c8aef03:22738:1875407735589248:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788528712.458336:0:22738:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788528712.458512:0:22684:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788528712.458523:0:22684:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788528712.458537:0:22684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c784e800/0x892c60dda91c949b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c94a2 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528712.458548:0:22684:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c784e800/0x892c60dda91c949b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c94a2 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788528712.458613:0:22684:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788528712.458615:0:22684:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788528712.458616:0:22684:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788528712.458623:0:22684:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788528712.458624:0:22684:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788528712.458625:0:22684:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788528712.458627:0:22684:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788528712.458629:0:22684:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788528712.458630:0:22684:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788528712.458632:0:22684:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788528712.458635:0:22684:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788528712.458637:0:22684:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788528712.458638:0:22684:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788528712.458639:0:22684:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788528712.458640:0:22684:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788528712.458641:0:22684:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788528712.458642:0:22684:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788528712.458644:0:22684:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788528712.458645:0:22684:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788528712.458646:0:22684:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788528712.458648:0:22684:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788528712.458729:0:22684:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788528712.458745:0:22684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:22684:1875407735589376:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788528712.458807:0:22684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528712.458842:0:22684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90de6c5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788528712.459907:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788528712.459957:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735589376 00000100:00100000:0.0:1788528712.459964:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735589376 00000100:00100000:0.0:1788528712.460010:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788528712.460019:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+12:22684:x1875407735589376:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788528712.460055:0:22700:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788528712.460069:0:22700:0:(mgs_nids.c:468:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788528712.470927:0:22700:0:(mgs_nids.c:820:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788528712.470941:0:22700:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788528712.471139:0:22721:0:(mgs_nids.c:717:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788528712.471145:0:22721:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788528712.471166:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a90c784e600/0x892c60dda91c94b7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528712.471187:0:22721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9101851200/0x892c60dda91c9486 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c947f expref: 12 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528712.471197:0:22721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a90c784e600/0x892c60dda91c94b7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528712.471235:0:22721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9101851200/0x892c60dda91c9486 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c947f expref: 12 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528712.471258:0:22721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a9101851200/0x892c60dda91c9486 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c947f expref: 12 pid: 22698 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528712.471272:0:22721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37aea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22721:1875407735589504:0@lo:104: 00000100:00100000:1.0:1788528712.471345:0:22721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528712.471461:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735589504 00000100:00100000:3.0:1788528712.471468:0:22688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735589504 00000100:00100000:3.0:1788528712.471529:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788528712.471539:0:22688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07f6b94a-1259-41bf-8282-a67e1c8aef03+3:22721:x1875407735589504:12345-0@lo:104: 00010000:00010000:3.0:1788528712.471574:0:22688:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3600/0x892c60dda91c947f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c9486 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528712.471722:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+12:22684:x1875407735589376:12345-0@lo:253:mount.lustre.0 Request processed in 11703us (12915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528712.471731:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788528712.471782:0:22684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:22684:1875407735589376:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788528712.471793:0:22684:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788528712.471796:0:22684:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788528712.471798:0:22684:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788528712.471799:0:22684:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788528712.471800:0:22684:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788528712.471801:0:22684:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788528712.471802:0:22684:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788528712.471803:0:22684:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788528712.471811:0:22684:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788528712.471813:0:22684:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788528712.471814:0:22684:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788528712.471829:0:22684:0:(tgt_mount.c:2815:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1788528712.479364:0:22688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788528712.479391:0:22688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07f6b94a-1259-41bf-8282-a67e1c8aef03+3:22721:x1875407735589504:12345-0@lo:104: Request processed in 7848us (8040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528712.479402:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788528712.479680:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788528712.479690:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3600/0x892c60dda91c947f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c9486 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528712.479716:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc26e3600 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:1.0:1788528712.479721:0:22694:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3600/0x892c60dda91c947f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c9486 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528712.479731:0:22694:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3600/0x892c60dda91c947f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c9486 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788528712.479737:0:22694:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3600/0x892c60dda91c947f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c9486 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528712.479743:0:22694:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788528712.479784:0:22694:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3600/0x892c60dda91c947f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c9486 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528712.479791:0:22694:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788528712.479816:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3600/0x892c60dda91c947f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c9486 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528712.479823:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3600/0x892c60dda91c947f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c9486 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528712.479842:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528712.479843:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528712.479845:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528712.479870:0:22721:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ee4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788528712.479902:0:22721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37aea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22721:1875407735589504:0@lo:104: 00010000:00010000:1.0:1788528712.479925:0:22721:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a90c784e600/0x892c60dda91c94b7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528712.480687:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788528712.480701:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07f6b94a-1259-41bf-8282-a67e1c8aef03:3640:1875407735589632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788528712.480756:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528712.481482:0:22690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735589632 00000100:00100000:0.0:1788528712.481491:0:22690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735589632 00010000:00010000:0.0:1788528712.481520:0:22690:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9101851200/0x892c60dda91c9486 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c947f expref: 12 pid: 22698 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528712.485707:0:22690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788528712.485722:0:22691:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788528712.485730:0:22690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07f6b94a-1259-41bf-8282-a67e1c8aef03+12:3640:x1875407735589632:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788528712.485736:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1788528712.485751:0:22690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528712.485762:0:22690:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9101851200/0x892c60dda91c9486 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c947f expref: 12 pid: 22698 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528712.485778:0:22690:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9101851200/0x892c60dda91c9486 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c947f expref: 12 pid: 22698 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528712.485796:0:22690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9101851200/0x892c60dda91c9486 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c947f expref: 12 pid: 22698 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528712.485817:0:22690:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a90c784e600/0x892c60dda91c94b7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528712.485825:0:22690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c784e600/0x892c60dda91c94b7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788528712.485843:0:22690:0:(mgs_nids.c:693:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014698143s 00010000:00010000:0.0:1788528712.485848:0:22690:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a90c784e600/0x892c60dda91c94b7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528712.485856:0:22690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a90c784e600/0x892c60dda91c94b7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528712.485875:0:22690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a90c784e600/0x892c60dda91c94b7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528712.485881:0:22690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a90c784e600/0x892c60dda91c94b7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528712.485887:0:22690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c784e600 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528712.485891:0:22690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a90c784e600/0x892c60dda91c94b7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528712.485900:0:22690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a90c784e600/0x892c60dda91c94b7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528712.485919:0:22690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a90c784e600/0x892c60dda91c94b7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528712.485929:0:22690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528712.486245:0:22690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07f6b94a-1259-41bf-8282-a67e1c8aef03+11:3640:x1875407735589632:12345-0@lo:103:ldlm_bl.0 Request processed in 525us (5487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528712.486258:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07f6b94a-1259-41bf-8282-a67e1c8aef03:3640:1875407735589632:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788528712.486266:0:22690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788528712.486297:0:22721:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a90c784e600/0x892c60dda91c94b7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528712.486306:0:22721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a90c784e600/0x892c60dda91c94b7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528712.486312:0:22721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c784e600/0x892c60dda91c94b7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788528712.511719:0:22684:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967530 00000040:01000000:1.0:1788528712.513358:0:22684:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1788528712.513812:0:22747:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788528712.513951:0:22684:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:0.0:1788528712.514274:0:22748:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8a90fe692a00 x1875407735589760/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528712.514290:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90cea86480 going to sleep for 0 seconds 00000040:01000000:3.0:1788528712.514795:0:22684:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788528712.514831:0:22684:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788528712.517513:0:22747:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788528712.519519:0:22747:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788528712.519640:0:22747:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00000080:3.0:1788528712.520111:0:22684:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788528712.520128:0:22684:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788528712.520216:0:22684:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:2.0:1788528712.520777:0:22746:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967530 00000020:00080000:2.0:1788528712.520782:0:22746:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000040:00080000:3.0:1788528712.521884:0:22684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788528712.523338:0:22684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788528712.523397:0:22684:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788528712.527502:0:22684:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:2.0:1788528712.528105:0:22684:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:2.0:1788528712.531889:0:22684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1788528712.537186:0:22684:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788528712.537229:0:22684:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9b7a00d1f9b8 00100000:10000000:2.0:1788528712.537238:0:22684:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788528712.538477:0:22684:0:(tgt_mount.c:2543:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788528712.538496:0:22684:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1788528712.548116:0:22684:0:(tgt_mount.c:2429:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788528712.548315:0:22684:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788528712.897014:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788528713.472346:0:22740:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788528713.472355:0:22740:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788528713.473458:0:22740:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788528713.473467:0:22740:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788528713.539953:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90cea86480 going to sleep for 0 seconds 10000000:01000000:0.0:1788528713.668580:0:22702:0:(mgc_request.c:714:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788528713.668586:0:22702:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-mdtir-ffff8a90ff704000 from 11 10000000:01000000:0.0:1788528713.668590:0:22702:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788528713.668629:0:22702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101850800/0x892c60dda91c94be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528713.668641:0:22702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a9101850800/0x892c60dda91c94be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528713.668652:0:22702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a9101850800/0x892c60dda91c94be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528713.668674:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe690700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735589888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788528713.668732:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528713.668768:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90cea86240 going to sleep for 11 seconds 00000100:00100000:2.0:1788528713.676495:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735589888 00000100:00100000:2.0:1788528713.676510:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735589888 00000100:00100000:2.0:1788528713.676593:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788528713.676606:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+11:22702:x1875407735589888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788528713.676622:0:22699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528713.676640:0:22699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c94c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c94be expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528713.676668:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c94c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c94be expref: 12 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528713.676679:0:22699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c94c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c94be expref: 12 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528713.676689:0:22699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc26e3200, rc 0) 00000100:00100000:2.0:1788528713.676782:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+12:22702:x1875407735589888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (8049us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528713.676788:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788528713.676930:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe690700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735589888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788528713.676950:0:22702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a9101850800/0x892c60dda91c94be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c94c5 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528713.676962:0:22702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a9101850800/0x892c60dda91c94be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c94c5 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528713.677028:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735590016:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788528713.677067:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528713.677088:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c6c8fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788528713.677139:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735590016 00000100:00100000:2.0:1788528713.677144:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735590016 00000100:00100000:2.0:1788528713.677170:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788528713.677176:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+12:22702:x1875407735590016:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788528713.677190:0:22700:0:(mgs_nids.c:920:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788528713.677205:0:22700:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788528713.677208:0:22700:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1788528713.677296:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+12:22702:x1875407735590016:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 120us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528713.677304:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788528713.677334:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735590016:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788528713.680773:0:22702:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788528713.680788:0:22702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101850800/0x892c60dda91c94be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c94c5 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528713.680800:0:22702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a9101850800/0x892c60dda91c94be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c94c5 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528713.918997:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788528714.496523:0:22740:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788528714.496535:0:22740:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788528714.496731:0:22740:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:1.0:1788528714.496944:0:22740:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788528714.498202:0:22740:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:1.0:1788528714.558680:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90cea86480 going to sleep for 0 seconds 00010000:00010000:0.0:1788528714.949195:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528715.582628:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90cea86480 going to sleep for 0 seconds 00010000:00010000:2.0:1788528715.970935:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528716.606651:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90cea86480 going to sleep for 0 seconds 00010000:00010000:2.0:1788528716.990794:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788528717.503038:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788528717.503044:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788528717.503047:0:469:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1d13800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788528717.503055:0:469:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 581 00000100:00080000:2.0:1788528717.503068:0:469:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788528717.503075:0:469:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a8fc1d13800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1788528717.503098:0:469:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90faa0ad80 x1875407735590272/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788528717.503113:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788528717.503117:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788528717.503120:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788528717.503123:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788528717.503126:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788528717.503128:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788528717.503130:0:469:0:(import.c:65:import_set_state_nolock()) ffff8a90c7d56800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788528717.503134:0:469:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8a90c7d56800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1788528717.503144:0:469:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90faa09500 x1875407735590400/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788528717.503620:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07f6b94a-1259-41bf-8282-a67e1c8aef03:3640:1875407735590144:0@lo:400:kworker.0 00000100:00100000:0.0:1788528717.503652:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735590272:0@lo:38:kworker.0 00000100:00100000:1.0:1788528717.503905:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528717.504680:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735590144 00000100:00100000:2.0:1788528717.504689:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735590144 00000100:00100000:2.0:1788528717.504738:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788528717.504747:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+12:3640:x1875407735590144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528717.517955:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528717.518069:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735590272 00000100:00100000:3.0:1788528717.518079:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735590272 00000100:00100000:0.0:1788528717.518086:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875407735590400:0@lo:38:kworker.0 00000100:00100000:3.0:1788528717.518112:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788528717.518119:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1875407735590272:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788528717.518137:0:22711:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788528717.518138:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528717.518182:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1875407735590272:12345-0@lo:38:kworker.0 Request processed in 62us (233us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788528717.518190:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788528717.518244:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735590400 00000100:00100000:3.0:1788528717.518248:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735590400 00000100:00080000:0.0:1788528717.518259:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1d13800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1788528717.518265:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788528717.518265:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788528717.518268:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735590272:0@lo:38:kworker.0 00000100:00100000:3.0:1788528717.518270:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1875407735590400:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788528717.518286:0:22707:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 586 last 0 00000020:00000080:3.0:1788528717.518321:0:22707:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x892c60dda91c94cc 00000004:00100000:3.0:1788528717.518335:0:22707:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788528717.518466:0:22707:0:(import.c:65:import_set_state_nolock()) ffff8a90c49f9000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788528717.518520:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875407735590400:12345-0@lo:38:kworker.0 Request processed in 248us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528717.518526:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788528717.518718:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a90faa09500 x1875407735590400/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788528727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788528717.518731:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788528717.518746:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788528717.518751:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788528717.518754:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90c7d56800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788528717.518759:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875407735590400:0@lo:38:kworker.0 00000100:00100000:3.0:1788528717.523136:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+12:3640:x1875407735590144:12345-0@lo:400:kworker.0 Request processed in 18381us (19437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528717.523150:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788528717.523261:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07f6b94a-1259-41bf-8282-a67e1c8aef03:3640:1875407735590144:0@lo:400:kworker.0 00000100:00100000:1.0:1788528717.634893:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90cea86480 going to sleep for 0 seconds 00010000:00010000:1.0:1788528718.014825:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788528718.428201:0:22991:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788528718.654628:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90cea86480 going to sleep for 0 seconds 00010000:00010000:1.0:1788528719.039810:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788528719.462361:0:23043:0:(tgt_mount.c:2429:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788528719.462536:0:23043:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788528719.678686:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90cea86480 going to sleep for 0 seconds 00010000:00010000:0.0:1788528720.062807:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788528720.204986:0:23093:0:(tgt_mount.c:2429:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788528720.205185:0:23093:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788528720.702643:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90cea86480 going to sleep for 0 seconds 00010000:00010000:1.0:1788528721.086780:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528721.726942:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90cea86480 going to sleep for 0 seconds 00010000:00010000:0.0:1788528722.125900:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528722.622708:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788528712/real 1788528712] req@ffff8a8fc37afb80 x1875407735587328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788528722 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528722.622739:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a8fc37afb80 x1875407735587328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788528722 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528722.622772:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788528712/real 1788528712] req@ffff8a8fc37af800 x1875407735587200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788528722 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528722.622785:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a8fc37af800 x1875407735587200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788528722 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788528722.622804:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1d13000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788528722.622812:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788528722.622816:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735587328:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788528722.622821:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3d1e000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788528722.622826:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788528722.622829:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735587200:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788528722.623238:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788528722.623244:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788528722.623247:0:469:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1d13800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788528722.623253:0:469:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 586 00000100:00080000:3.0:1788528722.623258:0:469:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788528722.623264:0:469:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a8fc1d13800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1788528722.623284:0:469:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90fa8ae300 x1875407735590656/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788528722.623314:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788528722.623317:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788528722.623319:0:469:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3d1e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788528722.623322:0:469:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 581 00000100:00080000:3.0:1788528722.623332:0:469:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788528722.623336:0:469:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a8fc3d1e000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1788528722.623350:0:469:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90fa8afb80 x1875407735590784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788528722.623360:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788528722.623362:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788528722.623364:0:469:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1d13000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788528722.623367:0:469:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 581 00000100:00080000:3.0:1788528722.623370:0:469:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788528722.623373:0:469:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a8fc1d13000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1788528722.623383:0:469:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90fa8af100 x1875407735590912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788528722.624431:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07f6b94a-1259-41bf-8282-a67e1c8aef03:3637:1875407735590528:0@lo:400:kworker.0 00000100:00100000:0.0:1788528722.624509:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528722.624578:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788528722.624585:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875407735591040:0@lo:400:kworker.0 00000100:00100000:0.0:1788528722.624613:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528722.624657:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735591040 00000100:00100000:0.0:1788528722.624664:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735591040 00000100:00100000:0.0:1788528722.624709:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788528722.624717:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875407735591040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528722.624768:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875407735591040:12345-0@lo:400:kworker.0 Request processed in 51us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528722.624775:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788528722.624812:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a90fa8aed80 x1875407735591040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528722.624825:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875407735591040:0@lo:400:kworker.0 00000100:00100000:3.0:1788528722.625150:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735590528 00000100:00100000:3.0:1788528722.625155:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735590528 00000100:00100000:3.0:1788528722.625285:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788528722.625292:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5893050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+12:3637:x1875407735590528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528722.625620:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5893050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+12:3637:x1875407735590528:12345-0@lo:400:kworker.0 Request processed in 327us (1110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528722.625628:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788528722.626449:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735590656:0@lo:38:kworker.0 00000100:00100000:1.0:1788528722.626500:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528722.626533:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735590784:0@lo:8:kworker.0 00000400:00000100:1.0:1788528722.626584:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875407735590784 offset 0 length 520: 4 00000100:00100000:1.0:1788528722.626614:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735590912:0@lo:8:kworker.0 00000400:00000100:1.0:1788528722.626639:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875407735590912 offset 0 length 520: 4 00000100:00100000:0.0:1788528722.626884:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07f6b94a-1259-41bf-8282-a67e1c8aef03:3637:1875407735590528:0@lo:400:kworker.0 00000100:00100000:3.0:1788528722.627036:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735590656 00000100:00100000:3.0:1788528722.627042:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735590656 00000100:00100000:3.0:1788528722.627113:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788528722.627120:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1875407735590656:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788528722.627139:0:22711:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788528722.627200:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1875407735590656:12345-0@lo:38:kworker.0 Request processed in 78us (698us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788528722.627215:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788528722.627313:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1d13800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788528722.627318:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788528722.627322:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735590656:0@lo:38:kworker.0 00000100:00100000:1.0:1788528722.751291:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90cea86480 going to sleep for 0 seconds 00010000:00010000:1.0:1788528723.134745:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528723.774933:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90cea86480 going to sleep for 0 seconds 00010000:00010000:0.0:1788528724.161337:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788528724.736917:0:22740:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788528724.800683:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90cea86480 going to sleep for 0 seconds 00010000:00010000:1.0:1788528725.192721:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528725.824802:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90cea86480 going to sleep for 0 seconds 00010000:00010000:3.0:1788528726.212296:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528726.848006:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90cea86480 going to sleep for 0 seconds 00010000:00010000:1.0:1788528727.238404:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788528727.593056:0:23438:0:(obd_mount.c:925:lmd_print()) mount data: 00000020:01000004:1.0:1788528727.593060:0:23438:0:(obd_mount.c:928:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788528727.593061:0:23438:0:(obd_mount.c:931:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788528727.593189:0:23438:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a90f5ac8800 00000020:01000004:1.0:1788528727.593204:0:23438:0:(tgt_mount.c:2585:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1788528727.593216:0:23438:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788528727.593232:0:23438:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8a910195b300) 00000020:00000080:1.0:1788528727.593248:0:23438:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788528727.660786:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1788528727.661850:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788528727.662867:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788528727.663321:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1788528727.663515:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788528727.663822:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1788528727.664040:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1788528727.664263:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788528727.664484:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788528727.664708:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788528727.664936:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788528727.665175:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788528727.665423:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788528727.665650:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788528727.667866:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788528727.668082:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1788528727.668321:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788528727.668640:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1788528727.668879:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788528727.669179:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788528727.669406:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788528727.669624:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788528727.669840:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788528727.670069:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788528727.670297:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788528727.670551:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788528727.670850:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788528727.671086:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1788528727.671322:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1788528727.671586:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788528727.671809:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788528727.672043:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788528727.672266:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1788528727.672508:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788528727.672785:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1788528727.673010:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788528727.673233:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788528727.673471:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1788528727.673675:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1788528727.673897:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1788528727.674116:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788528727.674352:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1788528727.674581:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788528727.674801:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788528727.675038:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788528727.675262:0:23438:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00080000:01000000:2.0:1788528727.675965:0:23438:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788528727.676245:0:23438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788528727.676256:0:23438:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788528727.676326:0:23438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x892c60dda91c94da 00000020:01000004:2.0:1788528727.676333:0:23438:0:(tgt_mount.c:2670:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788528727.676355:0:23438:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.138@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788528727.676359:0:23438:0:(mgc_request.c:1317:mgc_set_info_async()) InitRecov MGC192.168.203.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788528727.676364:0:23438:0:(tgt_mount.c:1882:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788528727.676395:0:23438:0:(tgt_mount.c:1482:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.138@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1788528727.676399:0:23438:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788528727.676400:0:23438:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788528727.676402:0:23438:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788528727.676403:0:23438:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788528727.676404:0:23438:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788528727.676406:0:23438:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788528727.676407:0:23438:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788528727.676409:0:23438:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788528727.676410:0:23438:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788528727.676413:0:23438:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1788528727.676415:0:23438:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788528727.676416:0:23438:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788528727.676417:0:23438:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788528727.676418:0:23438:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788528727.676419:0:23438:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788528727.676420:0:23438:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788528727.676425:0:23438:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788528727.676426:0:23438:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788528727.676428:0:23438:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788528727.676451:0:23438:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788528727.676469:0:23438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735591168:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788528727.676534:0:23438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528727.676678:0:23438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9101848840 going to sleep for 11 seconds 00000100:00100000:3.0:1788528727.676770:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735591168 00000100:00100000:3.0:1788528727.676777:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735591168 00000100:00100000:3.0:1788528727.676827:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788528727.676836:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5892050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+12:23438:x1875407735591168:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788528727.676876:0:22699:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788528727.676880:0:22699:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1788528727.676886:0:22699:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788528727.677250:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5892050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+12:23438:x1875407735591168:12345-0@lo:253:mount.lustre.0 Request processed in 413us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528727.677258:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788528727.677380:0:23438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735591168:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788528727.677390:0:23438:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788528727.677392:0:23438:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788528727.677394:0:23438:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788528727.677395:0:23438:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788528727.677396:0:23438:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788528727.677397:0:23438:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788528727.677398:0:23438:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788528727.677399:0:23438:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788528727.677400:0:23438:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788528727.677401:0:23438:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788528727.677417:0:23438:0:(tgt_mount.c:115:server_register_mount()) register mount ffff8a90f5ac8800 from lustre-MDT0001 10000000:01000000:2.0:1788528727.677442:0:23438:0:(mgc_request.c:2207:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1788528727.677445:0:23438:0:(mgc_request.c:423:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788528727.677451:0:23438:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8a90f5ac8800 10000000:01000000:2.0:1788528727.677455:0:23438:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788528727.677472:0:23438:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.203.138@tcp: setup lustre-MDT0001-osd 00000040:01000000:2.0:1788528727.678933:0:23438:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 1 is initialized 00000040:01000000:2.0:1788528727.681251:0:23438:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 10000000:01000000:2.0:1788528727.681322:0:23438:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-sptlrpc-ffff8a90f5ac8800 from 1 10000000:01000000:2.0:1788528727.681327:0:23438:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788528727.681368:0:23438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2200/0x892c60dda91c94e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528727.681379:0:23438:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2200/0x892c60dda91c94e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528727.681402:0:23438:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2200/0x892c60dda91c94e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528727.681426:0:23438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735591296:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788528727.681493:0:23438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528727.681619:0:23438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f8db7840 going to sleep for 11 seconds 00000100:00100000:0.0:1788528727.681727:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735591296 00000100:00100000:0.0:1788528727.681735:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735591296 00000100:00100000:0.0:1788528727.681809:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788528727.681819:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5890450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+12:23438:x1875407735591296:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788528727.681831:0:22700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528727.681843:0:22700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9101851400/0x892c60dda91c94e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c94e1 expref: -99 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528727.681865:0:22700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9101851400/0x892c60dda91c94e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c94e1 expref: 13 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528727.681877:0:22700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9101851400/0x892c60dda91c94e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c94e1 expref: 13 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528727.681885:0:22700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101851400, rc 0) 00000100:00100000:0.0:1788528727.681932:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5890450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+13:23438:x1875407735591296:12345-0@lo:101:mount.lustre.0 Request processed in 114us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528727.681939:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788528727.682016:0:23438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735591296:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788528727.682031:0:23438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2200/0x892c60dda91c94e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c94e8 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528727.682041:0:23438:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2200/0x892c60dda91c94e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c94e8 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528727.682107:0:23438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735591424:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788528727.682137:0:23438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528727.682252:0:23438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c6c8fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788528727.682343:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735591424 00000100:00100000:2.0:1788528727.682348:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735591424 00000100:00100000:2.0:1788528727.682372:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788528727.682378:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5891050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+13:23438:x1875407735591424:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788528727.682485:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5891050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+13:23438:x1875407735591424:12345-0@lo:501:mount.lustre.0 Request processed in 106us (347us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788528727.682492:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788528727.682710:0:23438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735591424:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788528727.682724:0:23438:0:(mgc_request_server.c:748:mgc_llog_local_copy()) MGC192.168.203.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:1.0:1788528727.682754:0:23438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735591552:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788528727.682792:0:23438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528727.682818:0:23438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c6c8fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788528727.682866:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735591552 00000100:00100000:2.0:1788528727.682870:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735591552 00000100:00100000:2.0:1788528727.682899:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788528727.682906:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5893c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+13:23438:x1875407735591552:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788528727.682960:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5893c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+13:23438:x1875407735591552:12345-0@lo:501:mount.lustre.0 Request processed in 54us (166us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788528727.682967:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788528727.683061:0:23438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735591552:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788528727.683079:0:23438:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788528727.683096:0:23438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2200/0x892c60dda91c94e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c94e8 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528727.683105:0:23438:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2200/0x892c60dda91c94e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c94e8 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528727.683114:0:23438:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff8a90f5ac8800 10000000:01000000:1.0:1788528727.683120:0:23438:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788528727.683163:0:23438:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.203.138@tcp: setup lustre-MDT0001-osd 00000040:01000000:1.0:1788528727.683234:0:23438:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 1 is initialized 00000040:01000000:1.0:1788528727.683241:0:23438:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 10000000:01000000:1.0:1788528727.683247:0:23438:0:(mgc_request.c:206:do_config_log_add()) do adding config log nodemap-ffff8a90fb07cc80 10000000:01000000:1.0:1788528727.683251:0:23438:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788528727.683277:0:23438:0:(mgc_request.c:2062:mgc_process_log()) Process log nodemap-ffff8a90fb07cc80 from 1 10000000:01000000:1.0:1788528727.683280:0:23438:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788528727.683300:0:23438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c784f200/0x892c60dda91c94ef lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528727.683308:0:23438:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c784f200/0x892c60dda91c94ef lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528727.683315:0:23438:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c784f200/0x892c60dda91c94ef lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528727.683327:0:23438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735591680:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788528727.683366:0:23438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528727.683392:0:23438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c6c8f000 going to sleep for 11 seconds 00000100:00100000:0.0:1788528727.683499:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735591680 00000100:00100000:0.0:1788528727.683504:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735591680 00000100:00100000:0.0:1788528727.683535:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788528727.683542:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5890050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+13:23438:x1875407735591680:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788528727.683550:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528727.683584:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9101851800/0x892c60dda91c94f6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c94ef expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528727.683613:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9101851800/0x892c60dda91c94f6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c94ef expref: 14 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528727.683621:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9101851800/0x892c60dda91c94f6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c94ef expref: 14 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528727.683630:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101851800, rc 0) 00000100:00100000:0.0:1788528727.683659:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5890050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+14:23438:x1875407735591680:12345-0@lo:101:mount.lustre.0 Request processed in 119us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528727.683665:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788528727.683812:0:23438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735591680:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788528727.683825:0:23438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c784f200/0x892c60dda91c94ef lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c94f6 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528727.683833:0:23438:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c784f200/0x892c60dda91c94ef lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c94f6 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528727.683846:0:23438:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788528727.683861:0:23438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c784f200/0x892c60dda91c94ef lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c94f6 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528727.683868:0:23438:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c784f200/0x892c60dda91c94ef lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c94f6 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528727.683876:0:23438:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-barrier-ffff8a90f5ac8800 10000000:01000000:1.0:1788528727.683880:0:23438:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788528727.683911:0:23438:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-barrier-ffff8a90f5ac8800 from 1 10000000:01000000:1.0:1788528727.683914:0:23438:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788528727.683929:0:23438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c784ec00/0x892c60dda91c94fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528727.683936:0:23438:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c784ec00/0x892c60dda91c94fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528727.683943:0:23438:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c784ec00/0x892c60dda91c94fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528727.683955:0:23438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735591808:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788528727.683988:0:23438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528727.684018:0:23438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c6c8f000 going to sleep for 11 seconds 00000100:00100000:0.0:1788528727.684075:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735591808 00000100:00100000:0.0:1788528727.684080:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735591808 00000100:00100000:0.0:1788528727.684111:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788528727.684117:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5892850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+14:23438:x1875407735591808:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788528727.684123:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528727.684132:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9101850400/0x892c60dda91c9504 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c94fd expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528727.684155:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9101850400/0x892c60dda91c9504 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c94fd expref: 15 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528727.684163:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9101850400/0x892c60dda91c9504 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c94fd expref: 15 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528727.684170:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101850400, rc 0) 00000100:00100000:0.0:1788528727.684198:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5892850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+15:23438:x1875407735591808:12345-0@lo:101:mount.lustre.0 Request processed in 82us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528727.684203:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788528727.684343:0:23438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735591808:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788528727.684355:0:23438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c784ec00/0x892c60dda91c94fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9504 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528727.684363:0:23438:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c784ec00/0x892c60dda91c94fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c9504 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528727.684375:0:23438:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788528727.684379:0:23438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c784ec00/0x892c60dda91c94fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9504 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528727.684386:0:23438:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c784ec00/0x892c60dda91c94fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9504 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528727.684392:0:23438:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788528727.684396:0:23438:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788528727.684416:0:23438:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.203.138@tcp: setup lustre-MDT0001-osd 00000040:01000000:1.0:1788528727.684468:0:23438:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 1 is initialized 00000040:01000000:1.0:1788528727.684474:0:23438:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 10000000:01000000:1.0:1788528727.684479:0:23438:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-mdtir-ffff8a90f5ac8800 10000000:01000000:1.0:1788528727.684484:0:23438:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788528727.684511:0:23438:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1788528727.684514:0:23438:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788528727.684530:0:23438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c784e600/0x892c60dda91c950b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528727.684536:0:23438:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c784e600/0x892c60dda91c950b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528727.684613:0:23438:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c784e600/0x892c60dda91c950b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528727.684628:0:23438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735591936:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788528727.684656:0:23438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528727.684702:0:23438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c6c8f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788528727.684820:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735591936 00000100:00100000:3.0:1788528727.684825:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735591936 00000100:00100000:0.0:1788528727.684865:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788528727.684872:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5892450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+15:23438:x1875407735591936:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788528727.684880:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528727.684888:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9101850e00/0x892c60dda91c9512 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c950b expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528727.684901:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9101850e00/0x892c60dda91c9512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c950b expref: 16 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528727.684909:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9101850e00/0x892c60dda91c9512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c950b expref: 16 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528727.684916:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101850e00, rc 0) 00000100:00100000:0.0:1788528727.684949:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5892450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+16:23438:x1875407735591936:12345-0@lo:101:mount.lustre.0 Request processed in 77us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528727.684954:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788528727.685016:0:23438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735591936:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788528727.685026:0:23438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c784e600/0x892c60dda91c950b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9512 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528727.685034:0:23438:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c784e600/0x892c60dda91c950b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c9512 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788528727.686066:0:23438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 46 count 46 00000040:00080000:1.0:1788528727.686587:0:23438:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788528727.690027:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].1, 224 off8416 00000040:00080000:1.0:1788528727.690078:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].2, 136 off8552 00000040:00080000:1.0:1788528727.690093:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].3, 176 off8728 00000040:00080000:1.0:1788528727.690106:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].4, 224 off8952 00000040:00080000:1.0:1788528727.690119:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].5, 224 off9176 00000040:00080000:1.0:1788528727.690134:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].6, 120 off9296 00000040:00080000:1.0:1788528727.690369:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].7, 112 off9408 00000040:00080000:1.0:1788528727.690392:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].8, 160 off9568 00000040:00080000:1.0:1788528727.690405:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].9, 224 off9792 00000040:00080000:1.0:1788528727.690418:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].10, 224 off10016 00000040:00080000:1.0:1788528727.690431:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].11, 88 off10104 00000040:00080000:1.0:1788528727.690444:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].12, 144 off10248 00000040:00080000:1.0:1788528727.690457:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].13, 152 off10400 00000040:00080000:1.0:1788528727.690480:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].14, 168 off10568 00000040:00080000:1.0:1788528727.690492:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].15, 224 off10792 00000040:00080000:1.0:1788528727.690505:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].16, 224 off11016 00000040:00080000:1.0:1788528727.690516:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].17, 80 off11096 00000040:00080000:1.0:1788528727.690528:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].18, 224 off11320 00000040:00080000:1.0:1788528727.690539:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].19, 224 off11544 00000040:00080000:1.0:1788528727.690628:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].20, 160 off11704 00000040:00080000:1.0:1788528727.690649:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].21, 224 off11928 00000040:00080000:1.0:1788528727.690664:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].22, 224 off12152 00000040:00080000:1.0:1788528727.690676:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].23, 80 off12232 00000040:00080000:1.0:1788528727.690690:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].24, 224 off12456 00000040:00080000:1.0:1788528727.690705:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].25, 224 off12680 00000040:00080000:1.0:1788528727.690720:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].26, 88 off12768 00000040:00080000:1.0:1788528727.690733:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].27, 144 off12912 00000040:00080000:1.0:1788528727.690745:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].28, 152 off13064 00000040:00080000:1.0:1788528727.690757:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].29, 136 off13200 00000040:00080000:1.0:1788528727.690770:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].30, 224 off13424 00000040:00080000:1.0:1788528727.690782:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].31, 224 off13648 00000040:00080000:1.0:1788528727.690794:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].32, 80 off13728 00000040:00080000:1.0:1788528727.690807:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].33, 224 off13952 00000040:00080000:1.0:1788528727.690820:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].34, 224 off14176 00000040:00080000:1.0:1788528727.690834:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].35, 88 off14264 00000040:00080000:1.0:1788528727.690846:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].36, 144 off14408 00000040:00080000:1.0:1788528727.690859:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].37, 152 off14560 00000040:00080000:1.0:1788528727.690872:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].38, 136 off14696 00000040:00080000:1.0:1788528727.690885:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].39, 224 off14920 00000040:00080000:1.0:1788528727.690898:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].40, 224 off15144 00000040:00080000:1.0:1788528727.690913:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].41, 80 off15224 00000040:00080000:1.0:1788528727.690926:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].42, 224 off15448 00000040:00080000:1.0:1788528727.690939:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].43, 224 off15672 00000040:00080000:1.0:1788528727.690952:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].44, 120 off15792 00000040:00080000:1.0:1788528727.690978:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].45, 224 off16016 00000040:00080000:1.0:1788528727.690984:0:23438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 45 count 46 00000100:00100000:1.0:1788528727.691090:0:23438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735592064:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788528727.691168:0:23438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528727.691201:0:23438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c6c8f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528727.691331:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735592064 00000100:00100000:0.0:1788528727.691339:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735592064 00000100:00100000:0.0:1788528727.691390:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788528727.691400:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5893450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+16:23438:x1875407735592064:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788528727.691628:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5893450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+16:23438:x1875407735592064:12345-0@lo:501:mount.lustre.0 Request processed in 229us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528727.691636:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788528727.691794:0:23438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735592064:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788528727.691844:0:23438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa08e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735592192:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788528727.691881:0:23438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528727.691943:0:23438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f8db7480 going to sleep for 11 seconds 00000100:00100000:0.0:1788528727.691973:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735592192 00000100:00100000:0.0:1788528727.691978:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735592192 00000100:00100000:0.0:1788528727.692034:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788528727.692041:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5891850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+16:23438:x1875407735592192:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788528727.692705:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5891850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+16:23438:x1875407735592192:12345-0@lo:503:mount.lustre.0 Request processed in 664us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528727.692719:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788528727.692781:0:23438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa08e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735592192:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788528727.693129:0:23438:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788528727.693212:0:23438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa08e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735592320:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788528727.693249:0:23438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528727.693413:0:23438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f8db7480 going to sleep for 11 seconds 00000100:00100000:1.0:1788528727.693479:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735592320 00000100:00100000:1.0:1788528727.693485:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735592320 00000100:00100000:1.0:1788528727.693511:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788528727.693519:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5891c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+16:23438:x1875407735592320:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788528727.694054:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5891c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+16:23438:x1875407735592320:12345-0@lo:502:mount.lustre.0 Request processed in 535us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528727.694062:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788528727.694134:0:23438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa08e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735592320:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788528727.694349:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].1, 224 off8416 00000040:00080000:2.0:1788528727.694376:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].2, 136 off8552 00000040:00080000:2.0:1788528727.694390:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].3, 176 off8728 00000040:00080000:2.0:1788528727.694404:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].4, 224 off8952 00000040:00080000:2.0:1788528727.694417:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].5, 224 off9176 00000040:00080000:2.0:1788528727.694429:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].6, 120 off9296 00000040:00080000:2.0:1788528727.694441:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].7, 112 off9408 00000040:00080000:2.0:1788528727.694452:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].8, 160 off9568 00000040:00080000:2.0:1788528727.694463:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].9, 224 off9792 00000040:00080000:2.0:1788528727.694475:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].10, 224 off10016 00000040:00080000:2.0:1788528727.694487:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].11, 88 off10104 00000040:00080000:2.0:1788528727.694499:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].12, 144 off10248 00000040:00080000:2.0:1788528727.694510:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].13, 152 off10400 00000040:00080000:2.0:1788528727.694524:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].14, 168 off10568 00000040:00080000:2.0:1788528727.694537:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].15, 224 off10792 00000040:00080000:2.0:1788528727.694550:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].16, 224 off11016 00000040:00080000:2.0:1788528727.694621:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].17, 80 off11096 00000040:00080000:2.0:1788528727.694635:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].18, 224 off11320 00000040:00080000:2.0:1788528727.694648:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].19, 224 off11544 00000040:00080000:2.0:1788528727.694660:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].20, 160 off11704 00000040:00080000:2.0:1788528727.694673:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].21, 224 off11928 00000040:00080000:2.0:1788528727.694686:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].22, 224 off12152 00000040:00080000:2.0:1788528727.694699:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].23, 80 off12232 00000040:00080000:2.0:1788528727.694714:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].24, 224 off12456 00000040:00080000:2.0:1788528727.694728:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].25, 224 off12680 00000040:00080000:2.0:1788528727.694754:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].26, 88 off12768 00000040:00080000:2.0:1788528727.694769:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].27, 144 off12912 00000040:00080000:2.0:1788528727.694785:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].28, 152 off13064 00000040:00080000:2.0:1788528727.694798:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].29, 136 off13200 00000040:00080000:2.0:1788528727.694811:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].30, 224 off13424 00000040:00080000:2.0:1788528727.694825:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].31, 224 off13648 00000040:00080000:2.0:1788528727.694839:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].32, 80 off13728 00000040:00080000:2.0:1788528727.694851:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].33, 224 off13952 00000040:00080000:2.0:1788528727.694864:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].34, 224 off14176 00000040:00080000:2.0:1788528727.694875:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].35, 88 off14264 00000040:00080000:2.0:1788528727.694887:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].36, 144 off14408 00000040:00080000:2.0:1788528727.694899:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].37, 152 off14560 00000040:00080000:2.0:1788528727.694911:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].38, 136 off14696 00000040:00080000:2.0:1788528727.694923:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].39, 224 off14920 00000040:00080000:2.0:1788528727.694935:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].40, 224 off15144 00000040:00080000:2.0:1788528727.694947:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].41, 80 off15224 00000040:00080000:2.0:1788528727.694960:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].42, 224 off15448 00000040:00080000:2.0:1788528727.694973:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].43, 224 off15672 00000040:00080000:2.0:1788528727.694985:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].44, 120 off15792 00000100:00100000:2.0:1788528727.695017:0:23438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa08e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735592448:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788528727.695065:0:23438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528727.695098:0:23438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f8db7480 going to sleep for 11 seconds 00000100:00100000:1.0:1788528727.695249:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735592448 00000100:00100000:1.0:1788528727.695256:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735592448 00000100:00100000:1.0:1788528727.695296:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788528727.695304:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5893850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+16:23438:x1875407735592448:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788528727.695403:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5893850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+16:23438:x1875407735592448:12345-0@lo:502:mount.lustre.0 Request processed in 99us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528727.695410:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788528727.695528:0:23438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa08e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735592448:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788528727.695605:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].45, 224 off16016 00000040:00080000:2.0:1788528727.695614:0:23438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1788528727.696204:0:23442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788528727.696215:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528727.696218:0:23442:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788528727.696223:0:23442:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1788528727.696226:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788528727.696244:0:23442:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8a90f7decc80) 00000020:00000080:2.0:1788528727.696262:0:23442:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1788528727.696334:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788528727.696411:0:23442:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788528727.696419:0:23442:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x892c60dda91c9520 00000020:00000080:2.0:1788528727.696639:0:23442:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1788528727.696644:0:23442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788528727.696648:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528727.696649:0:23442:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788528727.696652:0:23442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788528727.696656:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528727.696657:0:23442:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1788528727.696660:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788528727.696667:0:23442:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8a90f7deb300) 00000020:00000080:2.0:1788528727.696678:0:23442:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1788528727.696682:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788528727.696684:0:23442:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1788528727.696687:0:23442:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1788528727.696693:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788528727.696734:0:23442:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8a90f5ac8800 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1788528727.696746:0:23442:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8a90f7de8000) 00000020:00000080:2.0:1788528727.696754:0:23442:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1788528727.696815:0:23442:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788528727.696821:0:23442:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x892c60dda91c9535 00000020:00000080:2.0:1788528727.696907:0:23442:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1788528727.696914:0:23442:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788528727.696918:0:23442:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x892c60dda91c953c 00080000:01000000:2.0:1788528727.696923:0:23442:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788528727.696926:0:23442:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x892c60dda91c9543 00000100:00080000:1.0:1788528727.745373:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788528727.745382:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788528727.745386:0:469:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1d13800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788528727.745394:0:469:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 591 00000100:00080000:1.0:1788528727.745400:0:469:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788528727.745407:0:469:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a8fc1d13800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1788528727.745444:0:469:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a8fc37ac700 x1875407735592576/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788528727.745468:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788528727.745479:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788528727.745482:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788528727.745485:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788528727.745505:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735592576:0@lo:38:kworker.0 00000100:00100000:0.0:1788528727.745555:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875407735592704:0@lo:400:kworker.0 00000100:00100000:2.0:1788528727.745590:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528727.745597:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528727.746991:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735592576 00000100:00100000:2.0:1788528727.747003:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735592576 00000100:00100000:2.0:1788528727.747055:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788528727.747063:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1875407735592576:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1788528727.747082:0:22710:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0001: Not available for connect from 0@lo (not set up) 00000100:00100000:1.0:1788528727.750290:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735592704 00000100:00100000:1.0:1788528727.750305:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735592704 00000100:00100000:1.0:1788528727.750375:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788528727.750386:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875407735592704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528727.754269:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1875407735592576:12345-0@lo:38:kworker.0 Request processed in 7200us (8673us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788528727.754281:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788528727.754336:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1d13800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788528727.754341:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788528727.754345:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735592576:0@lo:38:kworker.0 00010000:00010000:3.0:1788528727.763866:0:23442:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1788528727.764800:0:23442:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:3.0:1788528727.765276:0:23442:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788528727.769197:0:23442:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788528727.769215:0:23442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788528727.769221:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528727.769223:0:23442:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788528727.769227:0:23442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788528727.769232:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528727.769234:0:23442:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788528727.769237:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788528727.769242:0:23442:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:00000080:3.0:1788528727.769544:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788528727.769577:0:23442:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8a90fa60b300) 00000020:00000080:3.0:1788528727.769600:0:23442:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1788528727.769616:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788528727.769699:0:23442:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788528727.769706:0:23442:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788528727.769713:0:23442:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x892c60dda91c9551 00010000:00080000:3.0:1788528727.769751:0:23442:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a90c81b1800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.138@tcp at head 00010000:00080000:0.0:1788528727.769868:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a8fc37ad180 x1875407735592704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528727.769884:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875407735592704:0@lo:400:kworker.0 00000100:00100000:1.0:1788528727.774968:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875407735592704:12345-0@lo:400:kworker.0 Request processed in 24574us (29358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528727.774985:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788528727.779242:0:23442:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1788528727.783670:0:23442:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788528727.783685:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788528727.783721:0:23442:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788528727.783742:0:23442:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x892c60dda91c9558 00000100:00080000:1.0:1788528727.783752:0:23442:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788528727.783757:0:23442:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a90c81b1800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1788528727.783791:0:23442:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a8fc37ad880 x1875407735592832/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788528727.783817:0:23442:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788528727.783847:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788528727.783851:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788528727.783854:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788528727.783856:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:1.0:1788528727.783901:0:23442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788528727.783911:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528727.783913:0:23442:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1788528727.783916:0:23442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788528727.783919:0:23442:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788528727.783921:0:23442:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788528727.783922:0:23442:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788528727.783924:0:23442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788528727.783926:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528727.783928:0:23442:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788528727.783930:0:23442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788528727.783934:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528727.783936:0:23442:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1788528727.783939:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788528727.783968:0:23442:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1788528727.784135:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735592832:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788528727.784211:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528727.784273:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735592832 00000100:00100000:3.0:1788528727.784280:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735592832 00000100:00100000:3.0:1788528727.784311:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788528727.784318:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1875407735592832:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788528727.784339:0:22711:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 596 last 0 00000020:00000080:3.0:1788528727.784368:0:22711:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x892c60dda91c955f 00000004:00100000:3.0:1788528727.784382:0:22711:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788528727.784388:0:22711:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000020:01000000:1.0:1788528727.784550:0:23442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788528727.784582:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528727.784584:0:23442:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1788528727.784587:0:23442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788528727.784589:0:23442:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1788528727.784591:0:23442:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788528727.784592:0:23442:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788528727.784594:0:23442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788528727.784596:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528727.784597:0:23442:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788528727.784600:0:23442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788528727.784603:0:23442:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788528727.784606:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528727.784608:0:23442:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788528727.784611:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788528727.784614:0:23442:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:01000000:1.0:1788528727.784635:0:23442:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788528727.784637:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788528727.784650:0:23442:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8a910195cc80) 00000020:00000080:1.0:1788528727.784663:0:23442:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1788528727.784675:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788528727.784735:0:23442:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1788528727.784741:0:23442:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788528727.784748:0:23442:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x892c60dda91c956d 00010000:00080000:1.0:1788528727.784786:0:23442:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a8fc3d0d000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.138@tcp at head 00010000:00010000:1.0:1788528727.784987:0:23442:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:1.0:1788528727.786126:0:23442:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788528727.786337:0:23442:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788528727.787816:0:23442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788528727.788353:0:23442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1788528727.788479:0:23442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1788528727.788956:0:23447:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788528727.788961:0:23447:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788528727.789707:0:23442:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788528727.789719:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788528727.789767:0:23442:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788528727.789790:0:23442:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x892c60dda91c9574 00000100:00080000:1.0:1788528727.789800:0:23442:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788528727.789806:0:23442:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8a8fc3d0d000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1788528727.789840:0:23442:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a8fc37ad500 x1875407735592960/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788528727.789895:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735592960:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788528727.789949:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875407735592960 offset 0 length 520: 4 00000100:00080000:1.0:1788528727.790003:0:23442:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788528727.790067:0:23442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788528727.790071:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528727.790073:0:23442:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788528727.790076:0:23442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788528727.790079:0:23442:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1788528727.790081:0:23442:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788528727.790082:0:23442:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788528727.790084:0:23442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788528727.790086:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528727.790098:0:23442:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788528727.790102:0:23442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788528727.790106:0:23442:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788528727.790110:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528727.790111:0:23442:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788528727.790114:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788528727.790118:0:23442:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:01000000:1.0:1788528727.790138:0:23442:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788528727.790140:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788528727.790165:0:23442:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8a9101959980) 00000020:00000080:1.0:1788528727.790178:0:23442:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1788528727.790184:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788528727.790251:0:23442:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1788528727.790258:0:23442:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788528727.790264:0:23442:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x892c60dda91c9582 00010000:00080000:1.0:1788528727.790293:0:23442:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a8fc1d14800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.138@tcp at head 00010000:00010000:1.0:1788528727.790486:0:23442:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1788528727.790628:0:23442:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788528727.790643:0:23442:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:2.0:1788528727.790825:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788528727.790830:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788528727.790832:0:469:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1d13800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788528727.790836:0:469:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 596 00000100:00080000:2.0:1788528727.790840:0:469:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788528727.790844:0:469:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a8fc1d13800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1788528727.790867:0:469:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90faa09c00 x1875407735593216/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788528727.790911:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07f6b94a-1259-41bf-8282-a67e1c8aef03:3640:1875407735593088:0@lo:400:kworker.0 00000100:00100000:0.0:1788528727.790957:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528727.791002:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735593088 00000100:00100000:0.0:1788528727.791010:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735593088 00000100:00100000:0.0:1788528727.791047:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788528727.791054:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735593216:0@lo:38:kworker.0 00000100:00100000:0.0:1788528727.791055:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5890850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+16:3640:x1875407735593088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528727.791092:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528727.791099:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5890850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+16:3640:x1875407735593088:12345-0@lo:400:kworker.0 Request processed in 45us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528727.791106:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788528727.791120:0:22710:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1788528727.791126:0:22710:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1788528727.791157:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07f6b94a-1259-41bf-8282-a67e1c8aef03:3640:1875407735593088:0@lo:400:kworker.0 00000100:00080000:2.0:1788528727.791271:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788528727.791275:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788528727.791278:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788528727.791281:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788528727.791304:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788528727.791307:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788528727.791330:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875407735593344:0@lo:400:kworker.0 00000100:00100000:2.0:1788528727.791382:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528727.791420:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735593344 00000100:00100000:2.0:1788528727.791423:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735593344 00000100:00100000:2.0:1788528727.791460:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788528727.791467:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875407735593344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528727.791510:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875407735593344:12345-0@lo:400:kworker.0 Request processed in 44us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528727.791516:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788528727.791595:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a90faa0b100 x1875407735593344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528727.791607:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875407735593344:0@lo:400:kworker.0 00000100:00100000:3.0:1788528727.791670:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735593216 00000100:00100000:3.0:1788528727.791675:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735593216 00000100:00100000:0.0:1788528727.791762:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788528727.791767:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3636:x1875407735593216:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788528727.791821:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3636:x1875407735593216:12345-0@lo:38:kworker.0 Request processed in 52us (729us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788528727.791836:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788528727.791841:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788528727.791848:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1d13800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788528727.791851:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788528727.791854:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735593216:0@lo:38:kworker.0 00000100:00080000:0.0:1788528727.794391:0:22711:0:(import.c:65:import_set_state_nolock()) ffff8a90c498c000 : changing import state from RECOVER to FULL 00000040:00080000:3.0:1788528727.794452:0:23442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788528727.794538:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3636:x1875407735592832:12345-0@lo:38:llog_process_th.0 Request processed in 10217us (10324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528727.794547:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:3.0:1788528727.794744:0:23442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1788528727.794964:0:23442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000100:00100000:2.0:1788528727.795182:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788528727.795192:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788528727.795200:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788528727.795206:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788528727.795209:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90c81b1800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788528727.795349:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735592832:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788528727.795470:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735593472:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788528727.795514:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528727.795640:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735593472 00000100:00100000:1.0:1788528727.795647:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735593472 00000100:00100000:1.0:1788528727.795688:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788528727.795697:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3638:x1875407735593472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788528727.795729:0:22710:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788528727.795851:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3638:x1875407735593472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 154us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528727.795858:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:0.0:1788528727.795891:0:23450:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788528727.795896:0:23450:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000100:00100000:2.0:1788528727.795984:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735593472:0@lo:41:osp-pre-0-1.0 00000020:00000080:1.0:1788528727.797010:0:23442:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788528727.797023:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788528727.797061:0:23442:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788528727.797084:0:23442:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x892c60dda91c9589 00000100:00080000:1.0:1788528727.797093:0:23442:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788528727.797098:0:23442:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a8fc1d14800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1788528727.797127:0:23442:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a8fc37ae300 x1875407735593600/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788528727.797195:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735593600:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788528727.797236:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875407735593600 offset 0 length 520: 4 00000100:00080000:1.0:1788528727.797359:0:23442:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788528727.797427:0:23442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788528727.797431:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528727.797433:0:23442:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788528727.797436:0:23442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788528727.797440:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528727.797442:0:23442:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788528727.797444:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788528727.797446:0:23442:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788528727.797448:0:23442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788528727.797450:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528727.797451:0:23442:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788528727.797454:0:23442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788528727.797456:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528727.797457:0:23442:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788528727.797461:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788528727.797486:0:23442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788528727.797489:0:23442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528727.797490:0:23442:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788528727.797494:0:23442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x26:0x0] index 46 count 46 00000020:01000000:0.0:1788528727.797591:0:23438:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1788528727.797604:0:23438:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788528727.797620:0:23438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c784e600/0x892c60dda91c950b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9512 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528727.797630:0:23438:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c784e600/0x892c60dda91c950b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9512 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528727.797637:0:23438:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-mdtir-ffff8a90f5ac8800 from 1 10000000:01000000:0.0:1788528727.797640:0:23438:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788528727.797663:0:23438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c9590 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528727.797671:0:23438:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c9590 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528727.797680:0:23438:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c9590 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528727.797695:0:23438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe690a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735593728:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788528727.797730:0:23438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788528727.797743:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788528727.797747:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788528727.797754:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1788528727.797762:0:23438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c2d79600 going to sleep for 11 seconds 00000100:00080000:3.0:1788528727.797829:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788528727.797854:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735593728 00000100:00100000:3.0:1788528727.797860:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735593728 00000100:00100000:3.0:1788528727.797901:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788528727.797914:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5890c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+16:23438:x1875407735593728:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788528727.797925:0:22699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528727.797937:0:22699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c6c82000/0x892c60dda91c9597 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c9590 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528727.797958:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c6c82000/0x892c60dda91c9597 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c9590 expref: 17 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528727.797968:0:22699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c6c82000/0x892c60dda91c9597 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c9590 expref: 17 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528727.797976:0:22699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c6c82000, rc 0) 00000100:00100000:3.0:1788528727.798019:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5890c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+17:23438:x1875407735593728:12345-0@lo:101:mount.lustre.0 Request processed in 106us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528727.798025:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788528727.798038:0:23438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe690a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735593728:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788528727.798052:0:23438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c9590 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9597 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528727.798061:0:23438:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c9590 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c9597 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528727.798754:0:23438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe690a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735593856:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788528727.798796:0:23438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528727.798830:0:23438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c2d79600 going to sleep for 11 seconds 00000100:00100000:2.0:1788528727.798848:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735593856 00000100:00100000:2.0:1788528727.798854:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735593856 00000100:00100000:2.0:1788528727.798894:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788528727.798902:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5891450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+17:23438:x1875407735593856:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788528727.798918:0:22698:0:(mgs_nids.c:920:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788528727.798933:0:22698:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788528727.798936:0:22698:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1788528727.799109:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5891450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+17:23438:x1875407735593856:12345-0@lo:256:mount.lustre.0 Request processed in 207us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528727.799117:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788528727.799187:0:23438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe690a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735593856:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788528727.800045:0:23438:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788528727.800108:0:23438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c9590 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9597 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528727.800121:0:23438:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c9590 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9597 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528727.800186:0:23438:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff8a90f5ac8800 from 1 10000000:01000000:1.0:1788528727.800189:0:23438:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788528727.800217:0:23438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c784f400/0x892c60dda91c959e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528727.800225:0:23438:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c784f400/0x892c60dda91c959e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528727.800234:0:23438:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c784f400/0x892c60dda91c959e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528727.800251:0:23438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735593984:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788528727.800304:0:23438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528727.800373:0:23438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d16accc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788528727.800890:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735593984 00000100:00100000:3.0:1788528727.800900:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735593984 00000100:00100000:3.0:1788528727.800983:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788528727.800993:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5892c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+17:23438:x1875407735593984:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788528727.801006:0:22699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528727.801019:0:22699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c6c83000/0x892c60dda91c95a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c959e expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528727.801055:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c6c83000/0x892c60dda91c95a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c959e expref: 18 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528727.801064:0:22699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c6c83000/0x892c60dda91c95a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c959e expref: 18 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528727.801073:0:22699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c6c83000, rc 0) 00000100:00100000:3.0:1788528727.801126:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5892c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+18:23438:x1875407735593984:12345-0@lo:101:mount.lustre.0 Request processed in 135us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528727.801134:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788528727.801213:0:23438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735593984:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788528727.801229:0:23438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c784f400/0x892c60dda91c959e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c95a5 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528727.801237:0:23438:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c784f400/0x892c60dda91c959e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c95a5 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788528727.802462:0:23438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x24:0x0] index 13 count 13 00000040:00080000:1.0:1788528727.802783:0:23438:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788528727.802953:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].1, 224 off8416 00000040:00080000:1.0:1788528727.802980:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].2, 112 off8528 00000040:00080000:1.0:1788528727.802996:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].3, 224 off8752 00000040:00080000:1.0:1788528727.803025:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].4, 224 off8976 00000040:00080000:1.0:1788528727.803038:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].5, 112 off9088 00000040:00080000:1.0:1788528727.803057:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].6, 224 off9312 00000040:00080000:1.0:1788528727.803070:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].7, 224 off9536 00000040:00080000:1.0:1788528727.803082:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].8, 128 off9664 00000040:00080000:1.0:1788528727.803094:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].9, 224 off9888 00000040:00080000:1.0:1788528727.803106:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].10, 224 off10112 00000040:00080000:1.0:1788528727.803118:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].11, 128 off10240 00000040:00080000:1.0:1788528727.803133:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].12, 224 off10464 00000040:00080000:1.0:1788528727.803139:0:23438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x24:0x0] index 12 count 13 00000100:00100000:1.0:1788528727.803219:0:23438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735594112:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788528727.803283:0:23438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528727.807669:0:23438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d16ac180 going to sleep for 11 seconds 00000100:00100000:2.0:1788528727.807921:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735594112 00000100:00100000:2.0:1788528727.807931:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735594112 00000100:00100000:2.0:1788528727.807983:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788528727.807992:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c4001850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+18:23438:x1875407735594112:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788528727.808161:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c4001850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+18:23438:x1875407735594112:12345-0@lo:501:mount.lustre.0 Request processed in 169us (4876us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528727.808168:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788528727.808259:0:23438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735594112:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788528727.808316:0:23438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735594240:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788528727.808367:0:23438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528727.808390:0:23438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d16ac180 going to sleep for 11 seconds 00000100:00100000:2.0:1788528727.808495:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735594240 00000100:00100000:2.0:1788528727.808499:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735594240 00000100:00100000:2.0:1788528727.808518:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788528727.808523:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c4003450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+18:23438:x1875407735594240:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788528727.808636:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c4003450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+18:23438:x1875407735594240:12345-0@lo:503:mount.lustre.0 Request processed in 111us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528727.808644:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788528727.808917:0:23438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735594240:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788528727.809430:0:23438:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788528727.809495:0:23438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735594368:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788528727.809539:0:23438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528727.809599:0:23438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d16accc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788528727.809652:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735594368 00000100:00100000:2.0:1788528727.809657:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735594368 00000100:00100000:2.0:1788528727.809693:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788528727.809701:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c4002450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+18:23438:x1875407735594368:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788528727.809809:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c4002450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+18:23438:x1875407735594368:12345-0@lo:502:mount.lustre.0 Request processed in 109us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528727.809816:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788528727.809947:0:23438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735594368:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788528727.810115:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].1, 224 off8416 00000040:00080000:1.0:1788528727.810153:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].2, 112 off8528 00000040:00080000:1.0:1788528727.810171:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].3, 224 off8752 00000040:00080000:1.0:1788528727.810184:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].4, 224 off8976 00000040:00080000:1.0:1788528727.810197:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].5, 112 off9088 00000040:00080000:1.0:1788528727.810225:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].6, 224 off9312 00000040:00080000:1.0:1788528727.810250:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].7, 224 off9536 00000040:00080000:1.0:1788528727.810263:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].8, 128 off9664 00000040:00080000:1.0:1788528727.810351:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].9, 224 off9888 00000040:00080000:1.0:1788528727.810367:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].10, 224 off10112 00000040:00080000:1.0:1788528727.810380:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].11, 128 off10240 00000100:00100000:1.0:1788528727.810403:0:23438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735594496:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788528727.810441:0:23438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528727.810467:0:23438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d16accc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788528727.810549:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735594496 00000100:00100000:3.0:1788528727.810571:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735594496 00000100:00100000:3.0:1788528727.810599:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788528727.810606:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c4002850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+18:23438:x1875407735594496:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788528727.810694:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c4002850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+18:23438:x1875407735594496:12345-0@lo:502:mount.lustre.0 Request processed in 88us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528727.810701:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788528727.810750:0:23438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735594496:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788528727.810863:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].12, 224 off10464 00000040:00080000:3.0:1788528727.810872:0:23438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788528727.811874:0:23452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788528727.811884:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528727.811886:0:23452:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788528727.811894:0:23452:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a90f5ac8800 00000020:00000080:2.0:1788528727.811897:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788528727.811906:0:23452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788528727.811909:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528727.811910:0:23452:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788528727.811912:0:23452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788528727.811914:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528727.811915:0:23452:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788528727.811919:0:23452:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a90f5ac8800 00000020:00000080:2.0:1788528727.811920:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788528727.812009:0:23452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788528727.812013:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528727.812015:0:23452:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788528727.812018:0:23452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788528727.812020:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528727.812022:0:23452:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788528727.812025:0:23452:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a90f5ac8800 00000020:00000080:2.0:1788528727.812027:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788528727.821236:0:23452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788528727.821250:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528727.821252:0:23452:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788528727.821257:0:23452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788528727.821317:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528727.821319:0:23452:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788528727.821327:0:23452:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a90f5ac8800 00000020:00000080:2.0:1788528727.821330:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788528727.821398:0:23452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788528727.821402:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528727.821403:0:23452:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788528727.821407:0:23452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x28:0x0] index 13 count 13 00000020:01000000:3.0:1788528727.821589:0:23438:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788528727.821603:0:23438:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788528727.821622:0:23438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c784f400/0x892c60dda91c959e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c95a5 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528727.821634:0:23438:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c784f400/0x892c60dda91c959e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c95a5 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528727.821689:0:23438:0:(mgc_request.c:2207:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788528727.821692:0:23438:0:(mgc_request.c:423:config_log_add()) add config log lustre-client-ffff8a90f5ac8800 10000000:01000000:3.0:1788528727.821695:0:23438:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff8a90f5ac8800 10000000:01000000:3.0:1788528727.821700:0:23438:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788528727.821717:0:23438:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.203.138@tcp: setup lustre-MDT0001-osd 00000040:01000000:3.0:1788528727.821872:0:23438:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 1 is initialized 00000040:01000000:3.0:1788528727.821880:0:23438:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 10000000:01000000:3.0:1788528727.821894:0:23438:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-client-ffff8a90f5ac8800 from 1 10000000:01000000:3.0:1788528727.821897:0:23438:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788528727.821930:0:23438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c6c82c00/0x892c60dda91c95ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528727.821937:0:23438:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c6c82c00/0x892c60dda91c95ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528727.821948:0:23438:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c6c82c00/0x892c60dda91c95ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528727.821971:0:23438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735594624:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788528727.822032:0:23438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528727.822068:0:23438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c8d93540 going to sleep for 11 seconds 00000100:00100000:3.0:1788528727.822092:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735594624 00000100:00100000:3.0:1788528727.822100:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735594624 00000100:00100000:3.0:1788528727.822141:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788528727.822161:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c4000050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+18:23438:x1875407735594624:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788528727.822175:0:22699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528727.822187:0:22699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c6c83200/0x892c60dda91c95b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c95ac expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528727.822221:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c6c83200/0x892c60dda91c95b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c95ac expref: 19 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528727.822231:0:22699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c6c83200/0x892c60dda91c95b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c95ac expref: 19 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528727.822241:0:22699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c6c83200, rc 0) 00000100:00100000:3.0:1788528727.823388:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c4000050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+19:23438:x1875407735594624:12345-0@lo:101:mount.lustre.0 Request processed in 1223us (1351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528727.823398:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788528727.823945:0:23438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735594624:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788528727.823967:0:23438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c6c82c00/0x892c60dda91c95ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c95b3 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528727.823978:0:23438:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c6c82c00/0x892c60dda91c95ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c95b3 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788528727.827644:0:23438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 52 count 51 00000040:00080000:0.0:1788528727.828022:0:23438:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788528727.828253:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].1, 224 off8416 00000040:00080000:0.0:1788528727.829702:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].2, 120 off8536 00000040:00080000:0.0:1788528727.829733:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].3, 168 off8704 00000040:00080000:0.0:1788528727.829747:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].4, 224 off8928 00000040:00080000:0.0:1788528727.830685:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].5, 224 off9152 00000040:00080000:0.0:1788528727.830718:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].6, 120 off9272 00000040:00080000:0.0:1788528727.830733:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].7, 168 off9440 00000040:00080000:0.0:1788528727.830746:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].8, 224 off9664 00000040:00080000:0.0:1788528727.830962:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].9, 224 off9888 00000040:00080000:0.0:1788528727.830992:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].10, 120 off10008 00000040:00080000:0.0:1788528727.831008:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].11, 224 off10232 00000040:00080000:0.0:1788528727.831024:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].12, 224 off10456 00000040:00080000:0.0:1788528727.831037:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].13, 88 off10544 00000040:00080000:0.0:1788528727.831049:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].14, 128 off10672 00000040:00080000:0.0:1788528727.831063:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].15, 144 off10816 00000040:00080000:0.0:1788528727.831075:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].16, 160 off10976 00000040:00080000:0.0:1788528727.831090:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].17, 224 off11200 00000040:00080000:0.0:1788528727.831105:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].18, 224 off11424 00000040:00080000:0.0:1788528727.831119:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].19, 80 off11504 00000040:00080000:0.0:1788528727.831166:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].20, 224 off11728 00000040:00080000:0.0:1788528727.831186:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].21, 224 off11952 00000040:00080000:0.0:1788528727.831200:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].22, 88 off12040 00000040:00080000:0.0:1788528727.831215:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].23, 128 off12168 00000040:00080000:0.0:1788528727.831231:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].24, 144 off12312 00000040:00080000:0.0:1788528727.831246:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].25, 160 off12472 00000040:00080000:0.0:1788528727.831261:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].26, 224 off12696 00000040:00080000:0.0:1788528727.832218:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].27, 224 off12920 00000040:00080000:0.0:1788528727.832236:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].28, 80 off13000 00000040:00080000:0.0:1788528727.832251:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].29, 224 off13224 00000040:00080000:0.0:1788528727.832276:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].30, 224 off13448 00000040:00080000:0.0:1788528727.832293:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].31, 88 off13536 00000040:00080000:0.0:1788528727.832305:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].32, 128 off13664 00000040:00080000:0.0:1788528727.832318:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].33, 144 off13808 00000040:00080000:0.0:1788528727.832330:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].34, 128 off13936 00000040:00080000:0.0:1788528727.832344:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].35, 224 off14160 00000040:00080000:0.0:1788528727.833529:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].36, 224 off14384 00000040:00080000:0.0:1788528727.833585:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].37, 80 off14464 00000040:00080000:0.0:1788528727.833599:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].38, 224 off14688 00000040:00080000:0.0:1788528727.833612:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].39, 224 off14912 00000040:00080000:0.0:1788528727.833623:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].40, 88 off15000 00000040:00080000:0.0:1788528727.833636:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].41, 128 off15128 00000040:00080000:0.0:1788528727.833649:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].42, 144 off15272 00000040:00080000:0.0:1788528727.833674:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].43, 128 off15400 00000040:00080000:0.0:1788528727.833687:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].44, 224 off15624 00000040:00080000:0.0:1788528727.833700:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].45, 224 off15848 00000040:00080000:0.0:1788528727.833713:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].46, 80 off15928 00000040:00080000:0.0:1788528727.833727:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].47, 224 off16152 00000040:00080000:0.0:1788528727.833740:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].48, 232 off16384 00000040:00080000:0.0:1788528727.834080:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].49, 224 off16608 00000040:00080000:0.0:1788528727.834103:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].50, 120 off16728 00000040:00080000:0.0:1788528727.834137:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].51, 224 off16952 00000040:00080000:0.0:1788528727.834162:0:23438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 51 count 51 00000100:00100000:0.0:1788528727.834277:0:23438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe691180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735594752:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788528727.834340:0:23438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528727.834386:0:23438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c82bd840 going to sleep for 11 seconds 00000100:00100000:0.0:1788528727.834417:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735594752 00000100:00100000:0.0:1788528727.834425:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735594752 00000100:00100000:0.0:1788528727.834474:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788528727.834484:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c4003c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+19:23438:x1875407735594752:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788528727.834634:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c4003c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+19:23438:x1875407735594752:12345-0@lo:501:mount.lustre.0 Request processed in 151us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528727.834642:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788528727.834686:0:23438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe691180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735594752:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788528727.834717:0:23438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe691180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735594880:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788528727.834753:0:23438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528727.835033:0:23438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c82bd840 going to sleep for 11 seconds 00000100:00100000:0.0:1788528727.837401:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735594880 00000100:00100000:0.0:1788528727.837416:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735594880 00000100:00100000:0.0:1788528727.837470:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788528727.837481:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c4001050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+19:23438:x1875407735594880:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788528727.837674:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c4001050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+19:23438:x1875407735594880:12345-0@lo:503:mount.lustre.0 Request processed in 195us (2919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528727.837682:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788528727.837752:0:23438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe691180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735594880:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788528727.838474:0:23438:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788528727.838703:0:23438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe691180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735595008:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788528727.839336:0:23438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528727.839388:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735595008 00000100:00100000:0.0:1788528727.839394:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735595008 00000100:00100000:0.0:1788528727.839447:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788528727.839455:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c4000450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+19:23438:x1875407735595008:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788528727.839913:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c4000450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+19:23438:x1875407735595008:12345-0@lo:502:mount.lustre.0 Request processed in 457us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528727.839921:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788528727.840042:0:23438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c82bd240 going to sleep for 11 seconds 00000100:00100000:0.0:1788528727.840063:0:23438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe691180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735595008:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788528727.841339:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].1, 224 off8416 00000040:00080000:0.0:1788528727.841382:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].2, 120 off8536 00000040:00080000:0.0:1788528727.841401:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].3, 168 off8704 00000040:00080000:0.0:1788528727.841415:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].4, 224 off8928 00000040:00080000:0.0:1788528727.841431:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].5, 224 off9152 00000040:00080000:0.0:1788528727.841442:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].6, 120 off9272 00000040:00080000:0.0:1788528727.841457:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].7, 168 off9440 00000040:00080000:0.0:1788528727.841472:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].8, 224 off9664 00000040:00080000:0.0:1788528727.841488:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].9, 224 off9888 00000040:00080000:0.0:1788528727.841504:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].10, 120 off10008 00000040:00080000:0.0:1788528727.841520:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].11, 224 off10232 00000040:00080000:0.0:1788528727.841932:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].12, 224 off10456 00000040:00080000:0.0:1788528727.841952:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].13, 88 off10544 00000040:00080000:0.0:1788528727.841983:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].14, 128 off10672 00000040:00080000:0.0:1788528727.842000:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].15, 144 off10816 00000040:00080000:0.0:1788528727.842015:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].16, 160 off10976 00000040:00080000:0.0:1788528727.842027:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].17, 224 off11200 00000040:00080000:0.0:1788528727.842040:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].18, 224 off11424 00000040:00080000:0.0:1788528727.842052:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].19, 80 off11504 00000040:00080000:0.0:1788528727.842064:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].20, 224 off11728 00000040:00080000:0.0:1788528727.842075:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].21, 224 off11952 00000040:00080000:0.0:1788528727.842087:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].22, 88 off12040 00000040:00080000:0.0:1788528727.842099:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].23, 128 off12168 00000040:00080000:0.0:1788528727.842114:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].24, 144 off12312 00000040:00080000:0.0:1788528727.842126:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].25, 160 off12472 00000040:00080000:0.0:1788528727.842140:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].26, 224 off12696 00000040:00080000:0.0:1788528727.842171:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].27, 224 off12920 00000040:00080000:0.0:1788528727.842184:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].28, 80 off13000 00000040:00080000:0.0:1788528727.842196:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].29, 224 off13224 00000040:00080000:0.0:1788528727.842223:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].30, 224 off13448 00000040:00080000:0.0:1788528727.842237:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].31, 88 off13536 00000040:00080000:0.0:1788528727.842250:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].32, 128 off13664 00000040:00080000:0.0:1788528727.842262:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].33, 144 off13808 00000040:00080000:0.0:1788528727.847159:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].34, 128 off13936 00000040:00080000:0.0:1788528727.847179:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].35, 224 off14160 00000040:00080000:0.0:1788528727.847193:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].36, 224 off14384 00000040:00080000:0.0:1788528727.847206:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].37, 80 off14464 00000040:00080000:0.0:1788528727.847220:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].38, 224 off14688 00000040:00080000:0.0:1788528727.847232:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].39, 224 off14912 00000040:00080000:0.0:1788528727.847246:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].40, 88 off15000 00000040:00080000:0.0:1788528727.847259:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].41, 128 off15128 00000040:00080000:0.0:1788528727.847270:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].42, 144 off15272 00000040:00080000:0.0:1788528727.847283:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].43, 128 off15400 00000040:00080000:0.0:1788528727.847297:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].44, 224 off15624 00000040:00080000:0.0:1788528727.847325:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].45, 224 off15848 00000040:00080000:0.0:1788528727.847357:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].46, 80 off15928 00000040:00080000:0.0:1788528727.847374:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].47, 224 off16152 00000040:00080000:0.0:1788528727.847386:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].48, 232 off16384 00000100:00100000:0.0:1788528727.847438:0:23438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe691180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735595136:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788528727.847513:0:23438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528727.849642:0:23438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c82bd240 going to sleep for 11 seconds 00000100:00100000:3.0:1788528727.851179:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735595136 00000100:00100000:3.0:1788528727.851191:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735595136 00000100:00100000:3.0:1788528727.851241:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788528727.851250:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c4002050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+19:23438:x1875407735595136:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788528727.851406:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c4002050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+19:23438:x1875407735595136:12345-0@lo:502:mount.lustre.0 Request processed in 157us (3893us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528727.851414:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788528727.851467:0:23438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe691180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735595136:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788528727.851710:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].49, 224 off16608 00000040:00080000:3.0:1788528727.851734:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].50, 120 off16728 00000100:00100000:3.0:1788528727.851764:0:23438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735595264:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788528727.851814:0:23438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528727.851841:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735595264 00000100:00100000:3.0:1788528727.851845:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735595264 00000100:00100000:3.0:1788528727.851867:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788528727.851873:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c4003050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+19:23438:x1875407735595264:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788528727.851931:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c4003050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+19:23438:x1875407735595264:12345-0@lo:502:mount.lustre.0 Request processed in 58us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528727.851938:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788528727.851972:0:23438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c8d936c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788528727.851983:0:23438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735595264:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788528727.852014:0:23438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].51, 224 off16952 00000040:00080000:3.0:1788528727.852020:0:23438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788528727.853017:0:23457:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1788528727.853031:0:23457:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8a9101958000) 00000020:00000080:1.0:1788528727.853050:0:23457:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1788528727.853128:0:23457:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8a90f5ac8800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788528727.853132:0:23457:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8a90f5ac8800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788528727.853134:0:23457:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8a90f5ac8800 3 00010000:00080000:1.0:1788528727.853175:0:23457:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a90c83ae800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.138@tcp at head 00010000:00010000:1.0:1788528727.858056:0:23457:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1788528727.860678:0:23457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1788528727.860739:0:23457:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788528727.860767:0:23457:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x892c60dda91c95c1 00000100:00080000:1.0:1788528727.860779:0:23457:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788528727.860785:0:23457:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a90c83ae800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1788528727.860827:0:23457:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a8fc37ad180 x1875407735595392/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788528727.860857:0:23457:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788528727.861503:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875407735595392:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788528727.861612:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788528727.861670:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788528727.861675:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788528727.861678:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788528727.861680:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1788528727.861983:0:23457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2a:0x0] index 52 count 51 00000020:01000000:3.0:1788528727.862034:0:23438:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788528727.862048:0:23438:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788528727.862064:0:23438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c6c82c00/0x892c60dda91c95ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c95b3 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528727.862074:0:23438:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c6c82c00/0x892c60dda91c95ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c95b3 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788528727.862121:0:23438:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788528727.862124:0:23438:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788528727.862125:0:23438:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788528727.862126:0:23438:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788528727.862130:0:23438:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788528727.862132:0:23438:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788528727.862133:0:23438:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788528727.862135:0:23438:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788528727.862136:0:23438:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788528727.862141:0:23438:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1788528727.862153:0:23438:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788528727.862154:0:23438:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788528727.862155:0:23438:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788528727.862156:0:23438:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788528727.862158:0:23438:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788528727.862159:0:23438:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788528727.862159:0:23438:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788528727.862161:0:23438:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788528727.862161:0:23438:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788528727.862180:0:23438:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788528727.862193:0:23438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735595520:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788528727.862231:0:23438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528727.862247:0:23438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c82fbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788528727.862480:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735595392 00000100:00100000:1.0:1788528727.862487:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735595392 00000100:00100000:1.0:1788528727.862520:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788528727.862527:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1875407735595392:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788528727.862619:0:22705:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 597 last 0 00000020:00000080:1.0:1788528727.862657:0:22705:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x892c60dda91c95c8 00000004:00100000:1.0:1788528727.862670:0:22705:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788528727.862699:0:22705:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3fdb800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788528727.862752:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875407735595392:12345-0@lo:38:llog_process_th.0 Request processed in 224us (1140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528727.862838:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735595520 00000100:00100000:3.0:1788528727.862842:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735595520 00000100:00100000:3.0:1788528727.862872:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788528727.862878:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c4002c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+19:23438:x1875407735595520:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788528727.862897:0:22700:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788528727.862910:0:22700:0:(mgs_nids.c:468:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1788528727.863034:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a8fc37ad180 x1875407735595392/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788528737 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528727.863045:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788528727.863052:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1788528727.863059:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788528727.863063:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788528727.863065:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a90c83ae800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788528727.863071:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875407735595392:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788528727.863451:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788528727.874229:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90cea86480 going to sleep for 0 seconds 00000001:00100000:3.0:1788528727.874595:0:22685:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1788528727.874639:0:22700:0:(mgs_nids.c:820:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788528727.874653:0:22700:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1788528727.875071:0:22721:0:(mgs_nids.c:717:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788528727.875076:0:22721:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788528727.875098:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a90c784fc00/0x892c60dda91c95cf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528727.875116:0:22721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c94c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c94be expref: 19 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528727.875124:0:22721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a90c6c82000/0x892c60dda91c9597 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c9590 expref: 19 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528727.875130:0:22721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a90c784fc00/0x892c60dda91c95cf lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528727.875183:0:22721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a90c6c82000/0x892c60dda91c9597 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c9590 expref: 19 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528727.875253:0:22721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a90c6c82000/0x892c60dda91c9597 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c9590 expref: 19 pid: 22699 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528727.875277:0:22721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37ac700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22721:1875407735595648:0@lo:104: 00000100:00100000:1.0:1788528727.875335:0:22721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788528727.875379:0:22721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c94c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c94be expref: 19 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528727.875394:0:22721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c94c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c94be expref: 19 pid: 22699 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528727.875403:0:22721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37af800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22721:1875407735595776:0@lo:104: 00000100:00100000:1.0:1788528727.875426:0:22721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528727.875447:0:22721:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d16ace40 going to sleep for 11 seconds 00000100:00100000:3.0:1788528727.875908:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735595648 00000100:00100000:3.0:1788528727.875916:0:22688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735595648 00000100:00100000:3.0:1788528727.875967:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735595776 00000100:00100000:3.0:1788528727.875971:0:22688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735595776 00000100:00100000:3.0:1788528727.875986:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788528727.875995:0:22688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07f6b94a-1259-41bf-8282-a67e1c8aef03+4:22721:x1875407735595648:12345-0@lo:104: 00010000:00010000:3.0:1788528727.876008:0:22688:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c9590 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c9597 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528727.876062:0:22688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788528727.876069:0:22688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07f6b94a-1259-41bf-8282-a67e1c8aef03+4:22721:x1875407735595648:12345-0@lo:104: Request processed in 75us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528727.876076:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788528727.876093:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788528727.876098:0:22688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07f6b94a-1259-41bf-8282-a67e1c8aef03+3:22721:x1875407735595776:12345-0@lo:104: 00010000:00010000:3.0:1788528727.876106:0:22688:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a9101850800/0x892c60dda91c94be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c94c5 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528727.876138:0:22688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788528727.876154:0:22688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07f6b94a-1259-41bf-8282-a67e1c8aef03+3:22721:x1875407735595776:12345-0@lo:104: Request processed in 46us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528727.876161:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788528727.876181:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788528727.876186:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c9590 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c9597 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528727.876206:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101851e00 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:3.0:1788528727.876211:0:22694:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c9590 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c9597 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528727.876218:0:22694:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c9590 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c9597 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788528727.876225:0:22694:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c9590 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c9597 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528727.876231:0:22694:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788528727.876258:0:22694:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c9590 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c9597 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528727.876954:0:22694:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788528727.876978:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c9590 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c9597 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528727.876986:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c9590 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c9597 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528727.876998:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788528727.877002:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a9101850800/0x892c60dda91c94be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c94c5 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528727.877007:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101850800 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:3.0:1788528727.877011:0:22694:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a9101850800/0x892c60dda91c94be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c94c5 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528727.877031:0:22694:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a9101850800/0x892c60dda91c94be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c94c5 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788528727.877038:0:22694:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a9101850800/0x892c60dda91c94be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c94c5 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528727.877044:0:22694:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788528727.877062:0:22694:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a9101850800/0x892c60dda91c94be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c94c5 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528727.877068:0:22694:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788528727.877074:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a9101850800/0x892c60dda91c94be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c94c5 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528727.877081:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a9101850800/0x892c60dda91c94be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c94c5 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528727.877093:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528727.877094:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528727.877096:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528727.877103:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528727.877122:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07f6b94a-1259-41bf-8282-a67e1c8aef03:3639:1875407735595904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788528727.877174:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528727.877201:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788528727.877207:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07f6b94a-1259-41bf-8282-a67e1c8aef03:3639:1875407735596032:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788528727.877227:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528727.877255:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735595904 00000100:00100000:3.0:1788528727.877260:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735595904 00010000:00010000:3.0:1788528727.877882:0:22691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a90c6c82000/0x892c60dda91c9597 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c9590 expref: 20 pid: 22699 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528727.877908:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735596032 00000100:00100000:3.0:1788528727.877912:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735596032 00010000:00010000:3.0:1788528727.877925:0:22691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c94c5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c94be expref: 21 pid: 22699 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528727.877943:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788528727.877950:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07f6b94a-1259-41bf-8282-a67e1c8aef03+21:3639:x1875407735595904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788528727.877962:0:22691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528727.877967:0:22691:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a90c6c82000/0x892c60dda91c9597 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c9590 expref: 21 pid: 22699 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528727.877978:0:22691:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a90c6c82000/0x892c60dda91c9597 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c9590 expref: 21 pid: 22699 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528727.877995:0:22691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788528727.878034:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07f6b94a-1259-41bf-8282-a67e1c8aef03+21:3639:x1875407735595904:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528727.878041:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788528727.878058:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788528727.878064:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07f6b94a-1259-41bf-8282-a67e1c8aef03+20:3639:x1875407735596032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788528727.878072:0:22691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528727.878076:0:22691:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c94c5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c94be expref: 20 pid: 22699 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528727.878086:0:22691:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c94c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c94be expref: 20 pid: 22699 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528727.878109:0:22691:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a90c784fc00/0x892c60dda91c95cf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528727.878118:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c784fc00/0x892c60dda91c95cf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788528727.878131:0:22691:0:(mgs_nids.c:693:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014698143s 00010000:00010000:3.0:1788528727.878136:0:22691:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a90c784fc00/0x892c60dda91c95cf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528727.878156:0:22691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a90c784fc00/0x892c60dda91c95cf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528727.878163:0:22691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a90c784fc00/0x892c60dda91c95cf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528727.878169:0:22691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a90c784fc00/0x892c60dda91c95cf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528727.878175:0:22691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c784fc00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528727.878179:0:22691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a90c784fc00/0x892c60dda91c95cf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528727.878186:0:22691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a90c784fc00/0x892c60dda91c95cf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528727.878195:0:22691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a90c784fc00/0x892c60dda91c95cf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528727.878204:0:22691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788528727.878229:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07f6b94a-1259-41bf-8282-a67e1c8aef03+20:3639:x1875407735596032:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528727.878241:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788528727.878507:0:22721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c6c82000/0x892c60dda91c9597 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c9590 expref: 19 pid: 22699 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528727.878519:0:22721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37ac700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22721:1875407735595648:0@lo:104: 00010000:00010000:1.0:1788528727.878528:0:22721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c94c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c94be expref: 18 pid: 22699 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528727.878535:0:22721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37af800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22721:1875407735595776:0@lo:104: 00010000:00010000:1.0:1788528727.878565:0:22721:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a90c784fc00/0x892c60dda91c95cf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528727.878573:0:22721:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a90c784fc00/0x892c60dda91c95cf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528727.878580:0:22721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a90c784fc00/0x892c60dda91c95cf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528727.878585:0:22721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c784fc00/0x892c60dda91c95cf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528727.879581:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c4002c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+17:23438:x1875407735595520:12345-0@lo:253:mount.lustre.0 Request processed in 16700us (17346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528727.879591:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788528727.879656:0:23438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:23438:1875407735595520:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788528727.879668:0:23438:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788528727.879671:0:23438:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788528727.879673:0:23438:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788528727.879674:0:23438:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788528727.879676:0:23438:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788528727.879677:0:23438:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788528727.879678:0:23438:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788528727.879680:0:23438:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788528727.879682:0:23438:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788528727.879683:0:23438:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788528727.879693:0:23438:0:(tgt_mount.c:2815:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788528727.882917:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07f6b94a-1259-41bf-8282-a67e1c8aef03:3639:1875407735596032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788528727.882933:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07f6b94a-1259-41bf-8282-a67e1c8aef03:3639:1875407735595904:0@lo:103:ldlm_bl.0 00000040:01000000:0.0:1788528727.902799:0:23438:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1788528727.902916:0:23464:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1788528727.902920:0:23464:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788528727.903237:0:23465:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1788528727.903665:0:23465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788528727.907057:0:23465:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788528727.907128:0:23465:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:01000000:1.0:1788528727.908535:0:23438:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1788528727.909516:0:23466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37af800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23466:1875407735596160:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788528727.909618:0:23466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528727.909688:0:23466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d16ac180 going to sleep for 11 seconds 00000040:01000000:3.0:1788528727.909726:0:23438:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:0.0:1788528727.909736:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735596160 00000100:00100000:0.0:1788528727.909744:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735596160 00000040:00080000:3.0:1788528727.909776:0:23438:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788528727.909904:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788528727.909913:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23466:x1875407735596160:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788528727.910036:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23466:x1875407735596160:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 123us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528727.910044:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788528727.910100:0:23466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37af800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23466:1875407735596160:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1788528727.910127:0:23466:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788528727.910166:0:23466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37af800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23466:1875407735596288:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788528727.910192:0:23466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528727.910212:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735596288 00000100:00100000:1.0:1788528727.910215:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735596288 00000100:00100000:1.0:1788528727.910278:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788528727.910287:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23466:x1875407735596288:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788528727.910395:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23466:x1875407735596288:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 109us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528727.910401:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788528727.910509:0:23466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d16accc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788528727.910525:0:23466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37af800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23466:1875407735596288:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788528727.910643:0:23466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37af800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23466:1875407735596416:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788528727.910673:0:23466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528727.910720:0:23466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc26953c0 going to sleep for 11 seconds 00000004:00000080:3.0:1788528727.910867:0:23438:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788528727.910877:0:23438:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:0.0:1788528727.910881:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735596416 00000100:00100000:0.0:1788528727.910885:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735596416 00000040:00080000:3.0:1788528727.910935:0:23438:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788528727.910958:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788528727.910967:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23466:x1875407735596416:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788528727.911017:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23466:x1875407735596416:12345-0@lo:900:lod0001_rec0000.0 Request processed in 52us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528727.911024:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788528727.911067:0:23466:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a8fc37af800 x1875407735596416/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788528743 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528727.911079:0:23466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37af800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23466:1875407735596416:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788528727.911113:0:23466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37af800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23466:1875407735596544:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788528727.911134:0:23466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528727.911166:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735596544 00000100:00100000:1.0:1788528727.911176:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735596544 00000100:00100000:1.0:1788528727.911197:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788528727.911202:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23466:x1875407735596544:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788528727.911244:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23466:x1875407735596544:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 42us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528727.911250:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788528727.911277:0:23466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc26956c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788528727.911290:0:23466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37af800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23466:1875407735596544:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1788528727.911327:0:23466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788528727.913741:0:23466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788528727.913813:0:23466:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788528727.913818:0:23466:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000040:00080000:3.0:1788528727.917093:0:23438:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788528727.917740:0:23438:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788528727.917777:0:23438:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1788528727.917943:0:23438:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788528727.921087:0:23438:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000001:00000004:3.0:1788528727.924212:0:23438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:3.0:1788528727.939960:0:23438:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788528727.940000:0:23438:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffff9b7a00d1f9b8 00100000:10000000:3.0:1788528727.940009:0:23438:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1788528727.941126:0:23438:0:(tgt_mount.c:2543:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788528727.941163:0:23438:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1788528727.945778:0:23438:0:(tgt_mount.c:2429:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788528727.946115:0:23438:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788528728.255364:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528728.894617:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90cea86480 going to sleep for 0 seconds 00000040:00080000:0.0:1788528728.895447:0:23462:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788528729.278685:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528729.919510:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90cea86480 going to sleep for 0 seconds 00000040:00080000:0.0:1788528729.928664:0:23462:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1788528729.928749:0:22702:0:(mgc_request.c:714:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788528729.928754:0:22702:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-mdtir-ffff8a90f5ac8800 from 12 10000000:01000000:2.0:1788528729.928757:0:22702:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788528729.928805:0:22702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3400/0x892c60dda91c95d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528729.928816:0:22702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3400/0x892c60dda91c95d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528729.928827:0:22702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3400/0x892c60dda91c95d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528729.928853:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa08a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735596672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788528729.928921:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528729.929193:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c8d930c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788528729.929371:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735596672 00000100:00100000:3.0:1788528729.929379:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735596672 00000100:00100000:3.0:1788528729.929461:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788528729.929471:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c4001450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+17:22702:x1875407735596672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788528729.929483:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528729.929497:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c6c83600/0x892c60dda91c95dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c95d6 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528729.929522:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c6c83600/0x892c60dda91c95dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c95d6 expref: 18 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528729.929531:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c6c83600/0x892c60dda91c95dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c95d6 expref: 18 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528729.929540:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c6c83600, rc 0) 00000100:00100000:3.0:1788528729.929713:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c4001450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+18:22702:x1875407735596672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 243us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528729.929720:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788528729.929802:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa08a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735596672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788528729.929818:0:22702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3400/0x892c60dda91c95d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c95dd expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528729.929826:0:22702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3400/0x892c60dda91c95d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c95dd expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528729.929884:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735596800:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788528729.929917:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528729.930024:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc2695180 going to sleep for 11 seconds 00000100:00100000:2.0:1788528729.930224:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735596800 00000100:00100000:2.0:1788528729.930230:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735596800 00000100:00100000:2.0:1788528729.930324:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788528729.930333:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c4000c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+18:22702:x1875407735596800:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788528729.930350:0:22699:0:(mgs_nids.c:920:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788528729.930374:0:22699:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788528729.930378:0:22699:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1788528729.930571:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c4000c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+18:22702:x1875407735596800:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 221us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528729.930580:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788528729.930750:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735596800:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788528729.930795:0:22702:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788528729.930803:0:22702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3400/0x892c60dda91c95d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c95dd expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528729.930813:0:22702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3400/0x892c60dda91c95d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c95dd expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528729.930825:0:22702:0:(mgc_request.c:714:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788528729.930826:0:22702:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-mdtir-ffff8a90ff704000 from 12 10000000:01000000:1.0:1788528729.930829:0:22702:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788528729.930849:0:22702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c784fc00/0x892c60dda91c95e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528729.930856:0:22702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c784fc00/0x892c60dda91c95e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528729.930865:0:22702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c784fc00/0x892c60dda91c95e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528729.930879:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735596928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788528729.930905:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528729.930962:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc2695180 going to sleep for 11 seconds 00000100:00100000:2.0:1788528729.931106:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735596928 00000100:00100000:2.0:1788528729.931112:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735596928 00000100:00100000:2.0:1788528729.931187:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788528729.931195:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c4000850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+18:22702:x1875407735596928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788528729.931204:0:22699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528729.931214:0:22699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a8fc26e3c00/0x892c60dda91c95eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c95e4 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528729.931229:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a8fc26e3c00/0x892c60dda91c95eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c95e4 expref: 19 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528729.931239:0:22699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a8fc26e3c00/0x892c60dda91c95eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c95e4 expref: 19 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528729.931247:0:22699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc26e3c00, rc 0) 00000100:00100000:2.0:1788528729.931351:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c4000850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+19:22702:x1875407735596928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528729.931357:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788528729.931410:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735596928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788528729.931422:0:22702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c784fc00/0x892c60dda91c95e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c95eb expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528729.931430:0:22702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c784fc00/0x892c60dda91c95e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c95eb expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528729.931481:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735597056:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788528729.931509:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528729.931595:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc2695180 going to sleep for 11 seconds 00000100:00100000:3.0:1788528729.931635:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735597056 00000100:00100000:3.0:1788528729.931640:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735597056 00000100:00100000:3.0:1788528729.931665:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788528729.931672:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c4003850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+19:22702:x1875407735597056:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788528729.931684:0:22698:0:(mgs_nids.c:920:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788528729.931697:0:22698:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788528729.931700:0:22698:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1788528729.931858:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c4003850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+19:22702:x1875407735597056:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 186us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528729.931866:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788528729.932015:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735597056:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788528729.932057:0:22702:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788528729.932063:0:22702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c784fc00/0x892c60dda91c95e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c95eb expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528729.932070:0:22702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c784fc00/0x892c60dda91c95e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c95eb expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528730.306368:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528730.942695:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90cea86480 going to sleep for 0 seconds 00010000:00010000:1.0:1788528731.326913:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528731.974884:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90cea86480 going to sleep for 0 seconds 00010000:00010000:3.0:1788528732.352392:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788528732.446162:0:23709:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788528732.863075:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788528732.863097:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735597184:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788528732.863174:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788528732.863400:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788528732.863405:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788528732.863408:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1d13800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788528732.863418:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a8fc1d13800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1788528732.863439:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90faa09f80 x1875407735597440/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788528732.863472:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788528732.863475:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788528732.863478:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788528732.863481:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788528732.863503:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788528732.863506:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788528732.863509:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788528732.863512:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788528732.863535:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735597440:0@lo:38:kworker.0 00000100:00100000:2.0:1788528732.863587:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528732.863619:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875407735597568:0@lo:400:kworker.0 00000100:00100000:2.0:1788528732.863647:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528732.863669:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788528732.863676:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875407735597696:0@lo:400:kworker.0 00000100:00100000:3.0:1788528732.863682:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735597184 00000100:00100000:3.0:1788528732.863690:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735597184 00000100:00100000:2.0:1788528732.863704:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528732.863736:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735597568 00000100:00100000:3.0:1788528732.863739:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735597440 00000100:00100000:2.0:1788528732.863740:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735597568 00000100:00100000:3.0:1788528732.863746:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735597440 00000100:00100000:3.0:1788528732.863768:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788528732.863779:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735597184:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788528732.863780:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735597696 00000100:00100000:2.0:1788528732.863786:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735597696 00000100:00100000:2.0:1788528732.863806:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788528732.863814:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875407735597568:12345-0@lo:400:kworker.0 00000004:00000024:3.0:1788528732.863818:0:22710:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788528732.863875:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875407735597568:12345-0@lo:400:kworker.0 Request processed in 58us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528732.863876:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735597184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528732.863887:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788528732.863899:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788528732.863909:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788528732.863914:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1875407735597440:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788528732.863920:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788528732.863927:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875407735597696:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788528732.863939:0:22710:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 602 last 0 00000100:00100000:2.0:1788528732.863966:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875407735597696:12345-0@lo:400:kworker.0 Request processed in 39us (262us total) trans 0 rc 0/0 00000020:00000080:3.0:1788528732.863976:0:22710:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x892c60dda91c95f2 00000004:00100000:3.0:1788528732.863989:0:22710:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788528732.863994:0:22710:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:1.0:1788528732.864090:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07f6b94a-1259-41bf-8282-a67e1c8aef03:3638:1875407735597312:0@lo:400:kworker.0 00000100:00100000:1.0:1788528732.864134:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528732.864191:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735597184:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788528732.864313:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788528732.864350:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a90faa09880 x1875407735597696/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528732.864361:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875407735597696:0@lo:400:kworker.0 00010000:00080000:2.0:1788528732.864373:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a90faa09180 x1875407735597568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528732.864381:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875407735597568:0@lo:400:kworker.0 00000100:00100000:3.0:1788528732.865524:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735597312 00000100:00100000:3.0:1788528732.865535:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735597312 00000100:00100000:3.0:1788528732.865623:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788528732.865632:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c4001c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+19:3638:x1875407735597312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528732.865719:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c4001c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+19:3638:x1875407735597312:12345-0@lo:400:kworker.0 Request processed in 89us (1584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528732.865726:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788528732.865866:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07f6b94a-1259-41bf-8282-a67e1c8aef03:3638:1875407735597312:0@lo:400:kworker.0 00000100:00080000:3.0:1788528732.879008:0:22710:0:(import.c:65:import_set_state_nolock()) ffff8a8fc45c4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788528732.879135:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1875407735597440:12345-0@lo:38:kworker.0 Request processed in 15217us (15545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528732.879145:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1788528732.881459:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788528732.881475:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788528732.881481:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788528732.881485:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1d13800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788528732.881518:0:3636:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000f62564da): req@ffff8a90fe692a00 x1875407735589760/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528732.881547:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735597440:0@lo:38:kworker.0 00000100:00100000:1.0:1788528732.882152:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528732.882193:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90cea86480 going to sleep for 11 seconds 00000100:00100000:2.0:1788528732.882249:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735597824:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788528732.882276:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528732.882395:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735589760 00000100:00100000:1.0:1788528732.882402:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735589760 00000100:00100000:1.0:1788528732.882447:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735597824 00000100:00100000:1.0:1788528732.882463:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735597824 00000100:00100000:1.0:1788528732.882481:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788528732.882489:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:22748:x1875407735589760:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788528732.882592:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:22748:x1875407735589760:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 103us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528732.882600:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788528732.882616:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788528732.882622:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1875407735597824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788528732.882643:0:23449:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788528732.882676:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1875407735597824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528732.882681:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788528732.882708:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe692a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22748:1875407735589760:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1788528732.882743:0:22748:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788528732.882776:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37ac000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22748:1875407735597952:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788528732.882807:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528732.882829:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc2695c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788528732.882839:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735597952 00000100:00100000:1.0:1788528732.882843:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735597952 00000100:00100000:1.0:1788528732.882859:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788528732.882864:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22748:x1875407735597952:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788528732.882963:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22748:x1875407735597952:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 97us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528732.882970:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788528732.883009:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37ac000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22748:1875407735597952:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788528732.883079:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37ac000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22748:1875407735598080:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788528732.883102:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528732.883128:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c82bdd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788528732.883141:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735598080 00000100:00100000:1.0:1788528732.883145:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735598080 00000100:00100000:1.0:1788528732.883161:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788528732.883166:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22748:x1875407735598080:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788528732.883210:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22748:x1875407735598080:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 43us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528732.883216:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788528732.883240:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37ac000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22748:1875407735598080:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788528732.883805:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735597824:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1788528732.884048:0:22748:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788528732.887206:0:22748:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788528732.887516:0:22748:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:1.0:1788528732.887521:0:22748:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:2.0:1788528733.359675:0:23761:0:(tgt_mount.c:2429:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788528733.359932:0:23761:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788528733.375650:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788528734.166724:0:23811:0:(tgt_mount.c:2429:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788528734.167013:0:23811:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788528734.398839:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788528734.976472:0:22740:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:3.0:1788528735.244163:0:23859:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff09219d30 20000000:00000080:3.0:1788528735.244186:0:23859:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a90f6989400 uarg=0000000000000000 20000000:01000000:3.0:1788528735.244238:0:23859:0:(mgs_llog.c:6198:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788528735.244252:0:23859:0:(mgs_llog.c:4653:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788528735.244258:0:23859:0:(mgs_llog.c:1385:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788528735.245338:0:23860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1788528735.245539:0:23859:0:(mgs_llog.c:1456:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788528735.252141:0:23859:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788528735.252184:0:23859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a90c6c82a00/0x892c60dda91c95f9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528735.252384:0:23859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a8fc26e2400/0x892c60dda91c9494 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c948d expref: 18 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528735.252392:0:23859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a90c6c83000/0x892c60dda91c95a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c959e expref: 18 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528735.252402:0:23859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a90c6c82a00/0x892c60dda91c95f9 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528735.252461:0:23859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a90c6c83000/0x892c60dda91c95a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c959e expref: 18 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528735.252479:0:23859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a90c6c83000/0x892c60dda91c95a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c959e expref: 18 pid: 22699 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528735.252497:0:23859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8adf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23859:1875407735598208:0@lo:104: 00000100:00100000:3.0:1788528735.252807:0:23859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788528735.252895:0:23859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a8fc26e2400/0x892c60dda91c9494 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c948d expref: 18 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528735.252905:0:23859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a8fc26e2400/0x892c60dda91c9494 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c948d expref: 18 pid: 22700 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528735.252914:0:23859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ac380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23859:1875407735598336:0@lo:104: 00000100:00100000:3.0:1788528735.252942:0:23859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528735.252969:0:23859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c7849d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788528735.253035:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735598208 00000100:00100000:1.0:1788528735.253045:0:22688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735598208 00000100:00100000:1.0:1788528735.253103:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735598336 00000100:00100000:1.0:1788528735.253106:0:22688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735598336 00000100:00100000:1.0:1788528735.253124:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788528735.253134:0:22688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07f6b94a-1259-41bf-8282-a67e1c8aef03+4:23859:x1875407735598208:12345-0@lo:104: 00010000:00010000:1.0:1788528735.253150:0:22688:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a90c784f400/0x892c60dda91c959e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c95a5 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528735.253239:0:22688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788528735.253245:0:22688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07f6b94a-1259-41bf-8282-a67e1c8aef03+4:23859:x1875407735598208:12345-0@lo:104: Request processed in 114us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528735.253263:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788528735.253296:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788528735.253303:0:22688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07f6b94a-1259-41bf-8282-a67e1c8aef03+3:23859:x1875407735598336:12345-0@lo:104: 00010000:00010000:1.0:1788528735.253311:0:22688:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83800/0x892c60dda91c948d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c9494 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528735.253345:0:22688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788528735.253350:0:22688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07f6b94a-1259-41bf-8282-a67e1c8aef03+3:23859:x1875407735598336:12345-0@lo:104: Request processed in 49us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528735.253357:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788528735.253374:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788528735.253381:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c784f400/0x892c60dda91c959e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c95a5 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528735.253389:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c784f400 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:1.0:1788528735.253393:0:22693:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c784f400/0x892c60dda91c959e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c95a5 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528735.253403:0:22693:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c784f400/0x892c60dda91c959e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c95a5 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788528735.253411:0:22693:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c784f400/0x892c60dda91c959e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c95a5 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528735.253417:0:22693:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788528735.253448:0:22693:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90c784f400/0x892c60dda91c959e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c95a5 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528735.253456:0:22693:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788528735.253486:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c784f400/0x892c60dda91c959e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c95a5 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528735.253494:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c784f400/0x892c60dda91c959e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c95a5 expref: -99 pid: 23438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528735.253509:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788528735.253512:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83800/0x892c60dda91c948d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c9494 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528735.253518:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c6c83800 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:1.0:1788528735.253521:0:22693:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83800/0x892c60dda91c948d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c9494 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528735.253527:0:22693:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83800/0x892c60dda91c948d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c9494 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788528735.253534:0:22693:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83800/0x892c60dda91c948d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c9494 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528735.253539:0:22693:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788528735.253579:0:22693:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83800/0x892c60dda91c948d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c9494 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528735.253586:0:22693:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788528735.253604:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83800/0x892c60dda91c948d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c9494 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528735.253611:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c6c83800/0x892c60dda91c948d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c9494 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528735.253639:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528735.253641:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528735.253642:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528735.253649:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528735.253671:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07f6b94a-1259-41bf-8282-a67e1c8aef03:3638:1875407735598464:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788528735.253704:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528735.253741:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07f6b94a-1259-41bf-8282-a67e1c8aef03:3639:1875407735598592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788528735.253763:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528735.253796:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735598464 00000100:00100000:1.0:1788528735.253800:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735598464 00010000:00010000:1.0:1788528735.253820:0:22743:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a90c6c83000/0x892c60dda91c95a5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c959e expref: 19 pid: 22699 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528735.253841:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735598592 00000100:00100000:1.0:1788528735.253845:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735598592 00010000:00010000:1.0:1788528735.253855:0:22743:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a8fc26e2400/0x892c60dda91c9494 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c948d expref: 20 pid: 22700 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528735.253871:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788528735.253878:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07f6b94a-1259-41bf-8282-a67e1c8aef03+20:3638:x1875407735598464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788528735.253889:0:22743:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528735.253894:0:22743:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a90c6c83000/0x892c60dda91c95a5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c959e expref: 20 pid: 22699 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528735.253905:0:22743:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a90c6c83000/0x892c60dda91c95a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c959e expref: 20 pid: 22699 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528735.253922:0:22743:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528735.253956:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07f6b94a-1259-41bf-8282-a67e1c8aef03+20:3638:x1875407735598464:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528735.253963:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788528735.253976:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788528735.253982:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4674a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07f6b94a-1259-41bf-8282-a67e1c8aef03+19:3639:x1875407735598592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788528735.253989:0:22743:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528735.253994:0:22743:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a8fc26e2400/0x892c60dda91c9494 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c948d expref: 19 pid: 22700 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528735.254002:0:22743:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a8fc26e2400/0x892c60dda91c9494 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c948d expref: 19 pid: 22700 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528735.254015:0:22743:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a90c6c82a00/0x892c60dda91c95f9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528735.254023:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c6c82a00/0x892c60dda91c95f9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528735.254045:0:22743:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a90c6c82a00/0x892c60dda91c95f9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528735.254054:0:22743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a90c6c82a00/0x892c60dda91c95f9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528735.254062:0:22743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a90c6c82a00/0x892c60dda91c95f9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528735.254069:0:22743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a90c6c82a00/0x892c60dda91c95f9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528735.254075:0:22743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c6c82a00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:1.0:1788528735.254085:0:22743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a90c6c82a00/0x892c60dda91c95f9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528735.254103:0:22743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a90c6c82a00/0x892c60dda91c95f9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528735.254112:0:22743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a90c6c82a00/0x892c60dda91c95f9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528735.254122:0:22743:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788528735.254149:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4674a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07f6b94a-1259-41bf-8282-a67e1c8aef03+19:3639:x1875407735598592:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528735.254157:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788528735.254201:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07f6b94a-1259-41bf-8282-a67e1c8aef03:3639:1875407735598592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788528735.254227:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07f6b94a-1259-41bf-8282-a67e1c8aef03:3638:1875407735598464:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788528735.254335:0:23859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c6c83000/0x892c60dda91c95a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c959e expref: 18 pid: 22699 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528735.254349:0:23859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8adf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23859:1875407735598208:0@lo:104: 00010000:00010000:3.0:1788528735.254361:0:23859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a8fc26e2400/0x892c60dda91c9494 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c948d expref: 17 pid: 22700 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528735.254371:0:23859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ac380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23859:1875407735598336:0@lo:104: 00010000:00010000:3.0:1788528735.254392:0:23859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a90c6c82a00/0x892c60dda91c95f9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528735.254401:0:23859:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a90c6c82a00/0x892c60dda91c95f9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528735.254408:0:23859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a90c6c82a00/0x892c60dda91c95f9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528735.254414:0:23859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c6c82a00/0x892c60dda91c95f9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528735.428377:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788528736.321451:0:22702:0:(mgc_request.c:714:do_requeue()) updating log params 10000000:01000000:2.0:1788528736.321468:0:22702:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff8a90f5ac8800 from 13 10000000:01000000:2.0:1788528736.321476:0:22702:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788528736.321541:0:22702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2e00/0x892c60dda91c9600 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528736.321573:0:22702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2e00/0x892c60dda91c9600 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528736.321587:0:22702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2e00/0x892c60dda91c9600 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528736.321678:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa09180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735598720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788528736.321828:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528736.321876:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d162ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528736.324059:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735598720 00000100:00100000:0.0:1788528736.324081:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735598720 00000100:00100000:0.0:1788528736.324176:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788528736.324199:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c680b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+17:22702:x1875407735598720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788528736.324220:0:22699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528736.324246:0:22699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9101850c00/0x892c60dda91c9607 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c9600 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528736.324281:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9101850c00/0x892c60dda91c9607 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c9600 expref: 18 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528736.324294:0:22699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9101850c00/0x892c60dda91c9607 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c9600 expref: 18 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528736.324305:0:22699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101850c00, rc 0) 00000100:00100000:0.0:1788528736.324390:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c680b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+18:22702:x1875407735598720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 195us (2562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528736.324398:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788528736.325336:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa09180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735598720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788528736.325366:0:22702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2e00/0x892c60dda91c9600 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9607 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528736.325378:0:22702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2e00/0x892c60dda91c9600 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c9607 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788528736.325639:0:22702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x28:0x0] index 13 count 13 00000040:00080000:2.0:1788528736.326093:0:22702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788528736.326356:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].1, 224 off8416 00000040:00080000:2.0:1788528736.326381:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].2, 112 off8528 00000040:00080000:2.0:1788528736.326392:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].3, 224 off8752 00000040:00080000:2.0:1788528736.326403:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].4, 224 off8976 00000040:00080000:2.0:1788528736.326413:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].5, 112 off9088 00000040:00080000:2.0:1788528736.326432:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].6, 224 off9312 00000040:00080000:2.0:1788528736.326444:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].7, 224 off9536 00000040:00080000:2.0:1788528736.326454:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].8, 128 off9664 00000040:00080000:2.0:1788528736.326466:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].9, 224 off9888 00000040:00080000:2.0:1788528736.326476:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].10, 224 off10112 00000040:00080000:2.0:1788528736.326487:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].11, 128 off10240 00000040:00080000:2.0:1788528736.326504:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].12, 224 off10464 00000040:00080000:2.0:1788528736.326509:0:22702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x28:0x0] index 12 count 13 00000100:00100000:2.0:1788528736.327292:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa09180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735598848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788528736.327381:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528736.327444:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d162ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528736.328368:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735598848 00000100:00100000:0.0:1788528736.328385:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735598848 00000100:00100000:0.0:1788528736.328471:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788528736.328484:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c6809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+18:22702:x1875407735598848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788528736.328707:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c6809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+18:22702:x1875407735598848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 225us (1326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528736.328844:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788528736.329019:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa09180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735598848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788528736.329079:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa09180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735598976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788528736.329143:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528736.329251:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d162ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528736.329296:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735598976 00000100:00100000:0.0:1788528736.329302:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735598976 00000100:00100000:0.0:1788528736.329348:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788528736.329355:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c6809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+18:22702:x1875407735598976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788528736.329463:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c6809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+18:22702:x1875407735598976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528736.329471:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788528736.329704:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa09180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735598976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788528736.333827:0:22702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788528736.333951:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735599104:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788528736.334052:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528736.334114:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78493c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788528736.335754:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735599104 00000100:00100000:2.0:1788528736.335770:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735599104 00000100:00100000:2.0:1788528736.335834:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788528736.335844:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c680ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+18:22702:x1875407735599104:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788528736.336038:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c680ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+18:22702:x1875407735599104:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 194us (1984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528736.336046:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788528736.336900:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735599104:0@lo:502:ll_cfg_requeue.0 00000040:00080000:3.0:1788528736.337230:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].1, 224 off8416 00000040:00080000:3.0:1788528736.339002:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].2, 112 off8528 00000040:00080000:3.0:1788528736.339026:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].3, 224 off8752 00000040:00080000:3.0:1788528736.339042:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].4, 224 off8976 00000040:00080000:3.0:1788528736.339056:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].5, 112 off9088 00000040:00080000:3.0:1788528736.339071:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].6, 224 off9312 00000040:00080000:3.0:1788528736.339096:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].7, 224 off9536 00000040:00080000:3.0:1788528736.339113:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].8, 128 off9664 00000040:00080000:3.0:1788528736.339128:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].9, 224 off9888 00000040:00080000:3.0:1788528736.339143:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].10, 224 off10112 00000040:00080000:3.0:1788528736.339157:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].11, 128 off10240 00000100:00100000:3.0:1788528736.339807:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735599232:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788528736.339918:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528736.339978:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78493c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788528736.340345:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735599232 00000100:00100000:2.0:1788528736.340356:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735599232 00000100:00100000:2.0:1788528736.340469:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788528736.340481:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c6808850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+18:22702:x1875407735599232:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788528736.340695:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c6808850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+18:22702:x1875407735599232:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 215us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528736.340704:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788528736.340832:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735599232:0@lo:502:ll_cfg_requeue.0 00000040:00080000:3.0:1788528736.340917:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].12, 224 off10464 00000040:00080000:3.0:1788528736.340934:0:22702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000040:00080000:3.0:1788528736.352276:0:23912:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2c:0x0] index 64768 count 13 00000020:01000000:0.0:1788528736.352623:0:22702:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788528736.352645:0:22702:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788528736.352660:0:22702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2e00/0x892c60dda91c9600 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9607 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528736.352674:0:22702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2e00/0x892c60dda91c9600 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9607 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528736.352688:0:22702:0:(mgc_request.c:714:do_requeue()) updating log params 10000000:01000000:0.0:1788528736.352691:0:22702:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff8a90ff704000 from 13 10000000:01000000:0.0:1788528736.352694:0:22702:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788528736.352915:0:22702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c960e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528736.352925:0:22702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c960e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528736.352939:0:22702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c960e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528736.352973:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe691880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735599360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788528736.353065:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528736.353162:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc3164600 going to sleep for 11 seconds 00000100:00100000:2.0:1788528736.353267:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735599360 00000100:00100000:2.0:1788528736.353277:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735599360 00000100:00100000:2.0:1788528736.353365:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788528736.353376:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+18:22702:x1875407735599360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788528736.353391:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528736.353406:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c9615 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c960e expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528736.353436:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c9615 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c960e expref: 19 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528736.353447:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c9615 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c960e expref: 19 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528736.353457:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc26e3200, rc 0) 00000100:00100000:2.0:1788528736.353518:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+19:22702:x1875407735599360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528736.353526:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788528736.353654:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe691880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735599360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788528736.353674:0:22702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c960e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9615 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528736.353683:0:22702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c960e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c9615 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528736.353756:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735599488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788528736.353785:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528736.354013:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78499c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528736.354044:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735599488 00000100:00100000:0.0:1788528736.354056:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735599488 00000100:00100000:0.0:1788528736.354093:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788528736.354101:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+19:22702:x1875407735599488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788528736.354240:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+19:22702:x1875407735599488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 139us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528736.354248:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788528736.354358:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735599488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788528736.354387:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735599616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788528736.354426:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528736.354444:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78499c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528736.354481:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735599616 00000100:00100000:0.0:1788528736.354485:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735599616 00000100:00100000:0.0:1788528736.354503:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788528736.354509:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+19:22702:x1875407735599616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788528736.354815:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+19:22702:x1875407735599616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 306us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528736.354823:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788528736.354922:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735599616:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788528736.356977:0:23913:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788528736.357253:0:22702:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788528736.357269:0:22702:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788528736.357284:0:22702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c960e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9615 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528736.357298:0:22702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c960e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9615 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528736.447209:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528737.471689:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528737.982621:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788528727/real 1788528727] req@ffff8a8fc37ae300 x1875407735593600/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788528737 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528737.982648:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a8fc37ae300 x1875407735593600/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788528737 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528737.982658:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788528727/real 1788528727] req@ffff8a8fc37ad500 x1875407735592960/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788528737 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528737.982669:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a8fc37ad500 x1875407735592960/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788528737 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528737.982687:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788528722/real 1788528722] req@ffff8a90fa8afb80 x1875407735590784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788528737 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528737.982699:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a90fa8afb80 x1875407735590784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788528737 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528737.982708:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788528722/real 1788528722] req@ffff8a90fa8af100 x1875407735590912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788528737 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528737.982718:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a90fa8af100 x1875407735590912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788528737 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788528737.982734:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1d14800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788528737.982757:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788528737.982761:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735593600:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788528737.982766:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3d0d000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788528737.982770:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788528737.982773:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735592960:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788528737.982777:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3d1e000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788528737.982781:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788528737.982783:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735590784:0@lo:8:kworker.0 00000100:00080000:3.0:1788528737.982788:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1d13000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788528737.982792:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788528737.982794:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735590912:0@lo:8:kworker.0 00000100:00080000:0.0:1788528737.982933:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788528737.982938:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788528737.982940:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3d1e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788528737.982945:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 591 00000100:00080000:0.0:1788528737.982950:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788528737.982956:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a8fc3d1e000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1788528737.982973:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90fe693480 x1875407735600000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788528737.982999:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788528737.983002:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788528737.983004:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1d13000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788528737.983007:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 591 00000100:00080000:0.0:1788528737.983016:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788528737.983020:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a8fc1d13000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1788528737.983033:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90fe692a00 x1875407735600128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788528737.983055:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788528737.983058:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788528737.983059:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3d0d000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788528737.983062:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 597 00000100:00080000:0.0:1788528737.983064:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788528737.983067:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8a8fc3d0d000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1788528737.983088:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90fe690000 x1875407735600512/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788528737.983096:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788528737.983108:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788528737.983110:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1d14800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788528737.983113:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 597 00000100:00080000:0.0:1788528737.983115:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788528737.983118:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a8fc1d14800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1788528737.983130:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90fe690700 x1875407735600640/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788528737.983131:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07f6b94a-1259-41bf-8282-a67e1c8aef03:3640:1875407735599744:0@lo:400:kworker.0 00000100:00100000:0.0:1788528737.983156:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735600000:0@lo:8:kworker.0 00000100:00100000:1.0:1788528737.983472:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735600384:0@lo:400:kworker.0 00000400:00000100:0.0:1788528737.988111:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875407735600000 offset 0 length 520: 4 00000100:00100000:0.0:1788528737.988161:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe692a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735600128:0@lo:8:kworker.0 00000400:00000100:0.0:1788528737.988191:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875407735600128 offset 0 length 520: 4 00000100:00100000:0.0:1788528737.988208:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735600512:0@lo:8:kworker.0 00000400:00000100:0.0:1788528737.988225:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875407735600512 offset 0 length 520: 4 00000100:00100000:0.0:1788528737.988234:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735600640:0@lo:8:kworker.0 00000400:00000100:0.0:1788528737.988247:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875407735600640 offset 0 length 520: 4 00000100:00100000:3.0:1788528737.988405:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528737.988423:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735599872:0@lo:400:kworker.0 00000100:00100000:0.0:1788528737.988453:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528737.988473:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735600896:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788528737.988488:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528737.988502:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788528737.988507:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875407735600256:0@lo:400:kworker.0 00000100:00100000:0.0:1788528737.988524:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528737.988927:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735599872 00000100:00100000:0.0:1788528737.988934:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735599872 00000100:00100000:0.0:1788528737.988970:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735600896 00000100:00100000:0.0:1788528737.988973:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735600896 00000100:00100000:0.0:1788528737.988990:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788528737.988997:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3637:x1875407735599872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528737.989044:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3637:x1875407735599872:12345-0@lo:400:kworker.0 Request processed in 47us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528737.989051:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788528737.989064:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788528737.989069:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1875407735600896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788528737.989267:0:23449:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788528737.989303:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1875407735600896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 234us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528737.989321:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788528737.989345:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735600256 00000100:00100000:0.0:1788528737.989348:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735600256 00000100:00100000:0.0:1788528737.989374:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788528737.989380:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875407735600256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528737.989411:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875407735600256:12345-0@lo:400:kworker.0 Request processed in 32us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528737.989418:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788528737.989454:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a90fe691180 x1875407735600256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528737.989468:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875407735600256:0@lo:400:kworker.0 00000100:00100000:0.0:1788528737.989478:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735599872:0@lo:400:kworker.0 00000100:00100000:0.0:1788528737.989490:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735600896:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788528737.989774:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735600768:0@lo:400:kworker.0 00000100:00100000:3.0:1788528737.989917:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528737.989971:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735599744 00000100:00100000:3.0:1788528737.989976:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735599744 00000100:00100000:3.0:1788528737.990012:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788528737.990020:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+19:3640:x1875407735599744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528737.990064:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+19:3640:x1875407735599744:12345-0@lo:400:kworker.0 Request processed in 45us (1660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528737.990071:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788528737.990190:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07f6b94a-1259-41bf-8282-a67e1c8aef03:3640:1875407735599744:0@lo:400:kworker.0 00000100:00100000:0.0:1788528737.990224:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735600768 00000100:00100000:0.0:1788528737.990228:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735600768 00000100:00100000:0.0:1788528737.991238:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788528737.991252:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735600768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528737.991304:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735600768:12345-0@lo:400:kworker.0 Request processed in 57us (1489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528737.991311:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788528737.991438:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528737.991509:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4675500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735601024:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788528737.991536:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528737.991634:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735600384 00000100:00100000:0.0:1788528737.991640:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735600384 00000100:00100000:0.0:1788528737.991665:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735601024 00000100:00100000:0.0:1788528737.991667:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735601024 00000100:00100000:0.0:1788528737.991679:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788528737.991693:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4674000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3639:x1875407735600384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528737.991740:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4674000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3639:x1875407735600384:12345-0@lo:400:kworker.0 Request processed in 47us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528737.991747:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788528737.991759:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788528737.991766:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4674380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735601024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788528737.991786:0:22711:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788528737.991819:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4674380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735601024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 54us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528737.991824:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788528737.992213:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4675500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735601024:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788528737.992238:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735600384:0@lo:400:kworker.0 00010000:00080000:3.0:1788528737.992333:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a90fe692300 x1875407735600768/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528737.992345:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735600768:0@lo:400:kworker.0 00010000:00010000:2.0:1788528738.496333:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788528738.498687:0:23439:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:0.0:1788528739.140452:0:23462:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788528739.518709:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528740.543802:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788528741.508676:0:24207:0:(obd_mount.c:925:lmd_print()) mount data: 00000020:01000004:1.0:1788528741.508686:0:24207:0:(obd_mount.c:928:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788528741.508687:0:24207:0:(obd_mount.c:931:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788528741.508804:0:24207:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a90f6f35800 00000020:01000004:1.0:1788528741.508820:0:24207:0:(tgt_mount.c:2585:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788528741.508832:0:24207:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788528741.508845:0:24207:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8a910195e600) 00000020:00000080:1.0:1788528741.508859:0:24207:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00010000:00010000:1.0:1788528741.566807:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1788528741.574793:0:24207:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788528741.580111:0:24207:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788528741.580866:0:24207:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788528741.581228:0:24207:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788528741.581991:0:24207:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788528741.582362:0:24207:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1788528741.582667:0:24207:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:1.0:1788528741.586521:0:24207:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788528741.588214:0:24207:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788528741.588229:0:24207:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788528741.588242:0:24207:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x892c60dda91c9623 00000020:01000004:1.0:1788528741.588249:0:24207:0:(tgt_mount.c:2670:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788528741.588271:0:24207:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.138@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788528741.588274:0:24207:0:(mgc_request.c:1317:mgc_set_info_async()) InitRecov MGC192.168.203.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788528741.588280:0:24207:0:(tgt_mount.c:1882:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788528741.588284:0:24207:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788528741.588297:0:24207:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8a90f6c49980) 00000020:00000080:1.0:1788528741.588309:0:24207:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:1.0:1788528741.589460:0:24207:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788528741.595115:0:24207:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788528741.595126:0:24207:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788528741.598618:0:24207:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788528741.598630:0:24207:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788528741.599305:0:24207:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788528741.599313:0:24207:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788528741.601707:0:24207:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788528741.601888:0:24207:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788528741.601893:0:24207:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788528741.604263:0:24207:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788528741.604281:0:24207:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788528741.620323:0:24207:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788528741.620704:0:24207:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788528741.620712:0:24207:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788528741.622246:0:24207:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788528741.622257:0:24207:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788528741.623247:0:24207:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788528741.623257:0:24207:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788528741.625794:0:24207:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788528741.625989:0:24207:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788528741.625995:0:24207:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788528741.626823:0:24207:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788528741.626882:0:24207:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788528741.667732:0:24207:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788528741.668006:0:24207:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788528741.668013:0:24207:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788528741.675339:0:24207:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788528741.675361:0:24207:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788528741.680710:0:24207:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788528741.680758:0:24207:0:(tgt_mount.c:1482:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.138@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788528741.680762:0:24207:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788528741.680764:0:24207:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788528741.680766:0:24207:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788528741.680767:0:24207:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788528741.680768:0:24207:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788528741.680770:0:24207:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788528741.680771:0:24207:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788528741.680773:0:24207:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788528741.680774:0:24207:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788528741.680778:0:24207:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788528741.680781:0:24207:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788528741.680782:0:24207:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788528741.680783:0:24207:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788528741.680784:0:24207:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788528741.680785:0:24207:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788528741.680786:0:24207:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788528741.680787:0:24207:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788528741.680789:0:24207:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788528741.680789:0:24207:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788528741.680879:0:24207:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788528741.680899:0:24207:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8afb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:24207:1875407735601152:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788528741.680966:0:24207:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528741.681057:0:24207:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c82e2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788528741.681105:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735601152 00000100:00100000:0.0:1788528741.681112:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735601152 00000100:00100000:0.0:1788528741.681255:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788528741.681265:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+19:24207:x1875407735601152:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788528741.681306:0:22699:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788528741.681309:0:22699:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788528741.681313:0:22699:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788528741.681750:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+19:24207:x1875407735601152:12345-0@lo:253:mount.lustre.0 Request processed in 486us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528741.681768:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788528741.681873:0:24207:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8afb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:24207:1875407735601152:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788528741.681884:0:24207:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788528741.681886:0:24207:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788528741.681888:0:24207:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788528741.681889:0:24207:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788528741.681890:0:24207:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788528741.681891:0:24207:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788528741.681892:0:24207:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788528741.681894:0:24207:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788528741.681895:0:24207:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788528741.681896:0:24207:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788528741.681912:0:24207:0:(tgt_mount.c:115:server_register_mount()) register mount ffff8a90f6f35800 from lustre-OST0000 10000000:01000000:2.0:1788528741.681938:0:24207:0:(mgc_request.c:2207:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788528741.681941:0:24207:0:(mgc_request.c:423:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788528741.681948:0:24207:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8a90f6f35800 10000000:01000000:2.0:1788528741.681953:0:24207:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788528741.681969:0:24207:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.203.138@tcp: setup lustre-OST0000-osd 00000040:01000000:2.0:1788528741.687330:0:24207:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 1 is initialized 00000040:01000000:2.0:1788528741.697731:0:24207:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 10000000:01000000:2.0:1788528741.697751:0:24207:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-sptlrpc-ffff8a90f6f35800 from 1 10000000:01000000:2.0:1788528741.697755:0:24207:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788528741.697794:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2800/0x892c60dda91c9631 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528741.697808:0:24207:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2800/0x892c60dda91c9631 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528741.697819:0:24207:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2800/0x892c60dda91c9631 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528741.697844:0:24207:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa09180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:24207:1875407735601280:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788528741.697910:0:24207:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528741.700396:0:24207:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90de3ebb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788528741.700971:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735601280 00000100:00100000:3.0:1788528741.700982:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735601280 00000100:00100000:3.0:1788528741.701056:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788528741.701067:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+19:24207:x1875407735601280:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788528741.701083:0:22700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528741.701103:0:22700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c6c83000/0x892c60dda91c9638 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c9631 expref: -99 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528741.701131:0:22700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c6c83000/0x892c60dda91c9638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c9631 expref: 20 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528741.701156:0:22700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c6c83000/0x892c60dda91c9638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c9631 expref: 20 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528741.701175:0:22700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c6c83000, rc 0) 00000100:00100000:3.0:1788528741.701243:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+20:24207:x1875407735601280:12345-0@lo:101:mount.lustre.0 Request processed in 169us (3323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528741.701250:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788528741.701426:0:24207:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa09180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:24207:1875407735601280:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788528741.701446:0:24207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2800/0x892c60dda91c9631 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9638 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528741.701455:0:24207:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2800/0x892c60dda91c9631 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c9638 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528741.701542:0:24207:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe693b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:24207:1875407735601408:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788528741.701603:0:24207:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528741.701637:0:24207:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f8e3cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788528741.701748:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735601408 00000100:00100000:1.0:1788528741.701754:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735601408 00000100:00100000:1.0:1788528741.701800:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788528741.701808:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+20:24207:x1875407735601408:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788528741.701897:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+20:24207:x1875407735601408:12345-0@lo:501:mount.lustre.0 Request processed in 91us (294us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788528741.701904:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788528741.702082:0:24207:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe693b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:24207:1875407735601408:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788528741.702106:0:24207:0:(mgc_request_server.c:748:mgc_llog_local_copy()) MGC192.168.203.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:0.0:1788528741.702141:0:24207:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe693b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:24207:1875407735601536:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788528741.702173:0:24207:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528741.702196:0:24207:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f8e3cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788528741.702329:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735601536 00000100:00100000:1.0:1788528741.702334:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735601536 00000100:00100000:1.0:1788528741.702365:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788528741.702372:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+20:24207:x1875407735601536:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788528741.702436:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+20:24207:x1875407735601536:12345-0@lo:501:mount.lustre.0 Request processed in 64us (270us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788528741.702443:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788528741.702645:0:24207:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe693b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:24207:1875407735601536:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788528741.702665:0:24207:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788528741.702721:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2800/0x892c60dda91c9631 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9638 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528741.702732:0:24207:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2800/0x892c60dda91c9631 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9638 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528741.702744:0:24207:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff8a90f6f35800 10000000:01000000:0.0:1788528741.702760:0:24207:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788528741.702790:0:24207:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.203.138@tcp: setup lustre-OST0000-osd 00000040:01000000:0.0:1788528741.702869:0:24207:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 1 is initialized 00000040:01000000:0.0:1788528741.702876:0:24207:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 10000000:01000000:0.0:1788528741.702885:0:24207:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788528741.702889:0:24207:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788528741.702903:0:24207:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.203.138@tcp: setup lustre-OST0000-osd 00000040:01000000:0.0:1788528741.702926:0:24207:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 1 is initialized 00000040:01000000:0.0:1788528741.702929:0:24207:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 10000000:01000000:0.0:1788528741.702935:0:24207:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788528741.702938:0:24207:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788528741.702959:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c963f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528741.702967:0:24207:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c963f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528741.702975:0:24207:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c963f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528741.702988:0:24207:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe693b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:24207:1875407735601664:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788528741.703018:0:24207:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528741.703037:0:24207:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f8e3c540 going to sleep for 11 seconds 00000100:00100000:2.0:1788528741.703127:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735601664 00000100:00100000:2.0:1788528741.703133:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735601664 00000100:00100000:2.0:1788528741.703161:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788528741.703179:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+20:24207:x1875407735601664:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788528741.703188:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528741.703199:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a8fc26e2600/0x892c60dda91c9646 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c963f expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528741.703217:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a8fc26e2600/0x892c60dda91c9646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c963f expref: 21 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528741.703226:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a8fc26e2600/0x892c60dda91c9646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c963f expref: 21 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528741.703234:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc26e2600, rc 0) 00000100:00100000:2.0:1788528741.703274:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+21:24207:x1875407735601664:12345-0@lo:101:mount.lustre.0 Request processed in 106us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528741.703280:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788528741.703912:0:24207:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe693b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:24207:1875407735601664:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788528741.703928:0:24207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c963f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9646 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528741.703937:0:24207:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c963f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c9646 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788528741.707511:0:24207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 14 count 14 00000040:00080000:0.0:1788528741.708333:0:24207:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788528741.712011:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].1, 224 off8416 00000040:00080000:0.0:1788528741.712081:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].2, 128 off8544 00000040:00080000:0.0:1788528741.712101:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].3, 112 off8656 00000040:00080000:0.0:1788528741.712117:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].4, 224 off8880 00000040:00080000:0.0:1788528741.712134:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].5, 224 off9104 00000040:00080000:0.0:1788528741.712147:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].6, 80 off9184 00000040:00080000:0.0:1788528741.712160:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].7, 224 off9408 00000040:00080000:0.0:1788528741.712310:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].8, 224 off9632 00000040:00080000:0.0:1788528741.712332:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].9, 80 off9712 00000040:00080000:0.0:1788528741.712345:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].10, 224 off9936 00000040:00080000:0.0:1788528741.712358:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].11, 224 off10160 00000040:00080000:0.0:1788528741.712685:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].12, 120 off10280 00000040:00080000:0.0:1788528741.712738:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].13, 224 off10504 00000040:00080000:0.0:1788528741.712745:0:24207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 13 count 14 00000100:00100000:0.0:1788528741.712850:0:24207:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe693b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:24207:1875407735601792:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788528741.712917:0:24207:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528741.713002:0:24207:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f8e3c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788528741.713055:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735601792 00000100:00100000:2.0:1788528741.713063:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735601792 00000100:00100000:2.0:1788528741.713154:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788528741.713165:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+21:24207:x1875407735601792:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788528741.713379:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+21:24207:x1875407735601792:12345-0@lo:501:mount.lustre.0 Request processed in 215us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528741.713388:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788528741.713681:0:24207:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe693b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:24207:1875407735601792:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788528741.713714:0:24207:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe693b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:24207:1875407735601920:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788528741.713756:0:24207:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528741.713784:0:24207:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f8e3c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788528741.713843:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735601920 00000100:00100000:3.0:1788528741.713848:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735601920 00000100:00100000:3.0:1788528741.713884:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788528741.713891:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+21:24207:x1875407735601920:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788528741.714672:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+21:24207:x1875407735601920:12345-0@lo:503:mount.lustre.0 Request processed in 780us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528741.714680:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788528741.714818:0:24207:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe693b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:24207:1875407735601920:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788528741.715345:0:24207:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788528741.715490:0:24207:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe693b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:24207:1875407735602048:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788528741.715546:0:24207:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528741.715673:0:24207:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f8e3c540 going to sleep for 11 seconds 00000100:00100000:2.0:1788528741.715747:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735602048 00000100:00100000:2.0:1788528741.715753:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735602048 00000100:00100000:2.0:1788528741.715783:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788528741.715798:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+21:24207:x1875407735602048:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788528741.716179:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+21:24207:x1875407735602048:12345-0@lo:502:mount.lustre.0 Request processed in 373us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528741.716188:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788528741.716361:0:24207:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe693b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:24207:1875407735602048:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788528741.716535:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].1, 224 off8416 00000040:00080000:0.0:1788528741.716593:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].2, 128 off8544 00000040:00080000:0.0:1788528741.716609:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].3, 112 off8656 00000040:00080000:0.0:1788528741.716623:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].4, 224 off8880 00000040:00080000:0.0:1788528741.716637:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].5, 224 off9104 00000040:00080000:0.0:1788528741.716649:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].6, 80 off9184 00000040:00080000:0.0:1788528741.716663:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].7, 224 off9408 00000040:00080000:0.0:1788528741.716676:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].8, 224 off9632 00000040:00080000:0.0:1788528741.716688:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].9, 80 off9712 00000040:00080000:0.0:1788528741.716702:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].10, 224 off9936 00000040:00080000:0.0:1788528741.716715:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].11, 224 off10160 00000040:00080000:0.0:1788528741.716729:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].12, 120 off10280 00000100:00100000:0.0:1788528741.716751:0:24207:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe693b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:24207:1875407735602176:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788528741.716791:0:24207:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528741.716817:0:24207:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f8e3c540 going to sleep for 11 seconds 00000100:00100000:2.0:1788528741.716939:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735602176 00000100:00100000:2.0:1788528741.716944:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735602176 00000100:00100000:2.0:1788528741.716966:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788528741.716972:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+21:24207:x1875407735602176:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788528741.717057:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+21:24207:x1875407735602176:12345-0@lo:502:mount.lustre.0 Request processed in 75us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528741.717064:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788528741.717189:0:24207:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe693b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:24207:1875407735602176:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788528741.717226:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].13, 224 off10504 00000040:00080000:0.0:1788528741.717234:0:24207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1788528741.722782:0:24224:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788528741.722793:0:24224:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1788528741.722818:0:24224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528741.722821:0:24224:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788528741.722827:0:24224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788528741.722858:0:24224:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8a8fc1c38000) 00000020:00000080:0.0:1788528741.722882:0:24224:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788528741.722888:0:24224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788528741.722973:0:24224:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8a90f6f35800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788528741.722981:0:24224:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788528741.722988:0:24224:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x892c60dda91c9654 00010000:00010000:0.0:1788528741.728307:0:24224:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1788528741.728990:0:24224:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:0.0:1788528741.738016:0:24224:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:0.0:1788528741.740100:0:24224:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788528741.740113:0:24224:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788528741.740119:0:24224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528741.740122:0:24224:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788528741.740125:0:24224:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788528741.740128:0:24224:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1788528741.740130:0:24224:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788528741.740131:0:24224:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788528741.740133:0:24224:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788528741.740135:0:24224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528741.740137:0:24224:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788528741.740139:0:24224:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788528741.740142:0:24224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528741.740144:0:24224:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788528741.740147:0:24224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788528741.740149:0:24224:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788528741.740151:0:24224:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788528741.740153:0:24224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528741.740154:0:24224:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788528741.740157:0:24224:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788528741.740160:0:24224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528741.740161:0:24224:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788528741.740164:0:24224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788528741.740260:0:24224:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788528741.740264:0:24224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788528741.740266:0:24224:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788528741.740269:0:24224:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 14 count 14 00000020:01000000:1.0:1788528741.740590:0:24207:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788528741.740605:0:24207:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788528741.740628:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c963f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9646 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528741.740639:0:24207:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a9101851e00/0x892c60dda91c963f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9646 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528741.740648:0:24207:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff8a90f6f35800 from 1 10000000:01000000:1.0:1788528741.740651:0:24207:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788528741.740688:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c784f400/0x892c60dda91c965b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528741.740697:0:24207:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c784f400/0x892c60dda91c965b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528741.740707:0:24207:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c784f400/0x892c60dda91c965b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528741.740742:0:24207:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4675500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:24207:1875407735602304:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788528741.740807:0:24207:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528741.740848:0:24207:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c7849180 going to sleep for 11 seconds 00000100:00100000:0.0:1788528741.740978:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735602304 00000100:00100000:0.0:1788528741.740992:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735602304 00000100:00100000:0.0:1788528741.741038:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788528741.741056:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+21:24207:x1875407735602304:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788528741.741069:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528741.741081:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9101850800/0x892c60dda91c9662 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c965b expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528741.741103:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9101850800/0x892c60dda91c9662 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c965b expref: 22 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528741.741114:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9101850800/0x892c60dda91c9662 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c965b expref: 22 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528741.741123:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101850800, rc 0) 00000100:00100000:0.0:1788528741.741157:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+22:24207:x1875407735602304:12345-0@lo:101:mount.lustre.0 Request processed in 111us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528741.741164:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788528741.741282:0:24207:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4675500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:24207:1875407735602304:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788528741.741297:0:24207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c784f400/0x892c60dda91c965b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9662 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528741.741306:0:24207:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c784f400/0x892c60dda91c965b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c9662 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788528741.742597:0:24207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 13 count 13 00000040:00080000:1.0:1788528741.742863:0:24207:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788528741.743088:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].1, 224 off8416 00000040:00080000:1.0:1788528741.743112:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].2, 112 off8528 00000040:00080000:1.0:1788528741.743126:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].3, 224 off8752 00000040:00080000:1.0:1788528741.743140:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].4, 224 off8976 00000040:00080000:1.0:1788528741.743153:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].5, 112 off9088 00000040:00080000:1.0:1788528741.743785:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].6, 224 off9312 00000040:00080000:1.0:1788528741.743809:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].7, 224 off9536 00000040:00080000:1.0:1788528741.743824:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].8, 128 off9664 00000040:00080000:1.0:1788528741.743837:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].9, 224 off9888 00000040:00080000:1.0:1788528741.743850:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].10, 224 off10112 00000040:00080000:1.0:1788528741.743865:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].11, 128 off10240 00000040:00080000:1.0:1788528741.743886:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].12, 224 off10464 00000040:00080000:1.0:1788528741.743892:0:24207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 12 count 13 00000100:00100000:1.0:1788528741.743979:0:24207:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4675500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:24207:1875407735602432:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788528741.744033:0:24207:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528741.744085:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735602432 00000100:00100000:1.0:1788528741.744100:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735602432 00000100:00100000:0.0:1788528741.745633:0:24207:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c7849540 going to sleep for 11 seconds 00000100:00100000:1.0:1788528741.747983:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788528741.748004:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+22:24207:x1875407735602432:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788528741.748207:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+22:24207:x1875407735602432:12345-0@lo:501:mount.lustre.0 Request processed in 212us (4173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528741.748216:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788528741.748313:0:24207:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4675500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:24207:1875407735602432:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788528741.748378:0:24207:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe693b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:24207:1875407735602560:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788528741.748440:0:24207:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528741.748479:0:24207:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c7d11780 going to sleep for 11 seconds 00000100:00100000:1.0:1788528741.748780:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735602560 00000100:00100000:1.0:1788528741.748788:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735602560 00000100:00100000:1.0:1788528741.748832:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788528741.748839:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+22:24207:x1875407735602560:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788528741.748930:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+22:24207:x1875407735602560:12345-0@lo:503:mount.lustre.0 Request processed in 91us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528741.748937:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788528741.749021:0:24207:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe693b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:24207:1875407735602560:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788528741.749465:0:24207:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788528741.749532:0:24207:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe693b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:24207:1875407735602688:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788528741.749608:0:24207:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528741.749629:0:24207:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c7d11780 going to sleep for 11 seconds 00000100:00100000:1.0:1788528741.749883:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735602688 00000100:00100000:1.0:1788528741.749888:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735602688 00000100:00100000:1.0:1788528741.749920:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788528741.749927:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+22:24207:x1875407735602688:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788528741.750000:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+22:24207:x1875407735602688:12345-0@lo:502:mount.lustre.0 Request processed in 73us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528741.750008:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788528741.750196:0:24207:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe693b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:24207:1875407735602688:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788528741.750373:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].1, 224 off8416 00000040:00080000:0.0:1788528741.750402:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].2, 112 off8528 00000040:00080000:0.0:1788528741.750541:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].3, 224 off8752 00000040:00080000:0.0:1788528741.750595:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].4, 224 off8976 00000040:00080000:0.0:1788528741.750613:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].5, 112 off9088 00000040:00080000:0.0:1788528741.750628:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].6, 224 off9312 00000040:00080000:0.0:1788528741.750643:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].7, 224 off9536 00000040:00080000:0.0:1788528741.750659:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].8, 128 off9664 00000040:00080000:0.0:1788528741.750672:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].9, 224 off9888 00000040:00080000:0.0:1788528741.750684:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].10, 224 off10112 00000040:00080000:0.0:1788528741.750697:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].11, 128 off10240 00000100:00100000:0.0:1788528741.750722:0:24207:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe693b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:24207:1875407735602816:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788528741.750764:0:24207:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528741.750786:0:24207:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c7d11780 going to sleep for 11 seconds 00000100:00100000:1.0:1788528741.750846:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735602816 00000100:00100000:1.0:1788528741.750851:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735602816 00000100:00100000:1.0:1788528741.750897:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788528741.750904:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+22:24207:x1875407735602816:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788528741.750969:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+22:24207:x1875407735602816:12345-0@lo:502:mount.lustre.0 Request processed in 66us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528741.750985:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788528741.751122:0:24207:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe693b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:24207:1875407735602816:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788528741.751162:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].12, 224 off10464 00000040:00080000:0.0:1788528741.751228:0:24207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788528741.753023:0:24228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788528741.753033:0:24228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528741.753036:0:24228:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788528741.753042:0:24228:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a90f6f35800 00000020:00000080:1.0:1788528741.753045:0:24228:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788528741.753063:0:24228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788528741.753066:0:24228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528741.753067:0:24228:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788528741.753070:0:24228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788528741.753073:0:24228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528741.753074:0:24228:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788528741.753077:0:24228:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a90f6f35800 00000020:00000080:1.0:1788528741.753079:0:24228:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788528741.753139:0:24228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788528741.753142:0:24228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528741.753144:0:24228:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788528741.753147:0:24228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788528741.753150:0:24228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528741.753151:0:24228:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788528741.753154:0:24228:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a90f6f35800 00000020:00000080:1.0:1788528741.753156:0:24228:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788528741.753184:0:24228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788528741.753188:0:24228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528741.753189:0:24228:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788528741.753192:0:24228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788528741.753194:0:24228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528741.753196:0:24228:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788528741.753199:0:24228:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a90f6f35800 00000020:00000080:1.0:1788528741.753201:0:24228:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788528741.753224:0:24228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788528741.753227:0:24228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528741.753234:0:24228:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788528741.753237:0:24228:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 13 count 13 00000020:01000000:2.0:1788528741.759421:0:24207:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788528741.759448:0:24207:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788528741.759474:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c784f400/0x892c60dda91c965b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9662 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528741.759487:0:24207:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c784f400/0x892c60dda91c965b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9662 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528741.759567:0:24207:0:(mgc_request.c:2207:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788528741.759570:0:24207:0:(mgc_request.c:423:config_log_add()) add config log lustre-client-ffff8a90f6f35800 10000000:01000000:2.0:1788528741.759574:0:24207:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff8a90f6f35800 10000000:01000000:2.0:1788528741.759581:0:24207:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788528741.759613:0:24207:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.203.138@tcp: setup lustre-OST0000-osd 00000040:01000000:2.0:1788528741.759689:0:24207:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 1 is initialized 00000040:01000000:2.0:1788528741.759697:0:24207:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 10000000:01000000:2.0:1788528741.759709:0:24207:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-client-ffff8a90f6f35800 from 1 10000000:01000000:2.0:1788528741.759712:0:24207:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788528741.759754:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2a00/0x892c60dda91c9669 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528741.759763:0:24207:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2a00/0x892c60dda91c9669 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528741.759773:0:24207:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2a00/0x892c60dda91c9669 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528741.759798:0:24207:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa09880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:24207:1875407735602944:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788528741.759885:0:24207:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528741.765018:0:24207:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f8e3ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788528741.765274:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735602944 00000100:00100000:1.0:1788528741.765284:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735602944 00000100:00100000:1.0:1788528741.765343:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788528741.765352:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+22:24207:x1875407735602944:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788528741.765367:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528741.765384:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c784e400/0x892c60dda91c9670 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c9669 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528741.766263:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c784e400/0x892c60dda91c9670 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c9669 expref: 23 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528741.766280:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c784e400/0x892c60dda91c9670 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c9669 expref: 23 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528741.766291:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c784e400, rc 0) 00000100:00100000:1.0:1788528741.766363:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+23:24207:x1875407735602944:12345-0@lo:101:mount.lustre.0 Request processed in 1011us (6477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528741.766370:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788528741.766590:0:24207:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa09880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:24207:1875407735602944:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788528741.766609:0:24207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2a00/0x892c60dda91c9669 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9670 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528741.766620:0:24207:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2a00/0x892c60dda91c9669 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c9670 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788528741.771032:0:24207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 52 count 51 00000040:00080000:1.0:1788528741.771347:0:24207:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788528741.772636:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].1, 224 off8416 00000040:00080000:1.0:1788528741.772673:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].2, 120 off8536 00000040:00080000:1.0:1788528741.772689:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].3, 168 off8704 00000040:00080000:1.0:1788528741.772702:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].4, 224 off8928 00000040:00080000:1.0:1788528741.772714:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].5, 224 off9152 00000040:00080000:1.0:1788528741.772726:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].6, 120 off9272 00000040:00080000:1.0:1788528741.772739:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].7, 168 off9440 00000040:00080000:1.0:1788528741.772754:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].8, 224 off9664 00000040:00080000:1.0:1788528741.772794:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].9, 224 off9888 00000040:00080000:1.0:1788528741.772810:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].10, 120 off10008 00000040:00080000:1.0:1788528741.772824:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].11, 224 off10232 00000040:00080000:1.0:1788528741.772838:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].12, 224 off10456 00000040:00080000:1.0:1788528741.772852:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].13, 88 off10544 00000040:00080000:1.0:1788528741.773741:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].14, 128 off10672 00000040:00080000:1.0:1788528741.773759:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].15, 144 off10816 00000040:00080000:1.0:1788528741.773772:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].16, 160 off10976 00000040:00080000:1.0:1788528741.773784:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].17, 224 off11200 00000040:00080000:1.0:1788528741.773797:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].18, 224 off11424 00000040:00080000:1.0:1788528741.773810:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].19, 80 off11504 00000040:00080000:1.0:1788528741.773822:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].20, 224 off11728 00000040:00080000:1.0:1788528741.773834:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].21, 224 off11952 00000040:00080000:1.0:1788528741.773847:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].22, 88 off12040 00000040:00080000:1.0:1788528741.774243:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].23, 128 off12168 00000040:00080000:1.0:1788528741.774269:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].24, 144 off12312 00000040:00080000:1.0:1788528741.774300:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].25, 160 off12472 00000040:00080000:1.0:1788528741.774317:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].26, 224 off12696 00000040:00080000:1.0:1788528741.774332:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].27, 224 off12920 00000040:00080000:1.0:1788528741.774346:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].28, 80 off13000 00000040:00080000:1.0:1788528741.774359:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].29, 224 off13224 00000040:00080000:1.0:1788528741.774372:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].30, 224 off13448 00000040:00080000:1.0:1788528741.774385:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].31, 88 off13536 00000040:00080000:1.0:1788528741.774399:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].32, 128 off13664 00000040:00080000:1.0:1788528741.774643:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].33, 144 off13808 00000040:00080000:1.0:1788528741.774664:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].34, 128 off13936 00000040:00080000:1.0:1788528741.774678:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].35, 224 off14160 00000040:00080000:1.0:1788528741.774691:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].36, 224 off14384 00000040:00080000:1.0:1788528741.774705:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].37, 80 off14464 00000040:00080000:1.0:1788528741.774720:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].38, 224 off14688 00000040:00080000:1.0:1788528741.774735:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].39, 224 off14912 00000040:00080000:1.0:1788528741.774749:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].40, 88 off15000 00000040:00080000:1.0:1788528741.774777:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].41, 128 off15128 00000040:00080000:1.0:1788528741.774803:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].42, 144 off15272 00000040:00080000:1.0:1788528741.774817:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].43, 128 off15400 00000040:00080000:1.0:1788528741.774832:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].44, 224 off15624 00000040:00080000:1.0:1788528741.774846:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].45, 224 off15848 00000040:00080000:1.0:1788528741.775382:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].46, 80 off15928 00000040:00080000:1.0:1788528741.775406:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].47, 224 off16152 00000040:00080000:1.0:1788528741.775422:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].48, 232 off16384 00000040:00080000:1.0:1788528741.776156:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].49, 224 off16608 00000040:00080000:1.0:1788528741.776186:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].50, 120 off16728 00000040:00080000:1.0:1788528741.776279:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].51, 224 off16952 00000040:00080000:1.0:1788528741.776288:0:24207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 51 count 51 00000100:00100000:1.0:1788528741.776398:0:24207:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4674e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:24207:1875407735603072:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788528741.776463:0:24207:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528741.776508:0:24207:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78493c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788528741.776773:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735603072 00000100:00100000:3.0:1788528741.776782:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735603072 00000100:00100000:3.0:1788528741.776826:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788528741.776835:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+23:24207:x1875407735603072:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788528741.777036:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+23:24207:x1875407735603072:12345-0@lo:501:mount.lustre.0 Request processed in 201us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528741.777043:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788528741.777304:0:24207:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4674e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:24207:1875407735603072:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788528741.777342:0:24207:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe693b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:24207:1875407735603200:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788528741.777386:0:24207:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528741.777411:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735603200 00000100:00100000:0.0:1788528741.777416:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735603200 00000100:00100000:0.0:1788528741.777440:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788528741.777446:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+23:24207:x1875407735603200:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788528741.777541:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+23:24207:x1875407735603200:12345-0@lo:503:mount.lustre.0 Request processed in 95us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528741.777584:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788528741.777637:0:24207:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78f0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528741.778315:0:24207:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe693b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:24207:1875407735603200:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788528741.780284:0:24207:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788528741.780374:0:24207:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe693b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:24207:1875407735603328:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788528741.780444:0:24207:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528741.780525:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735603328 00000100:00100000:3.0:1788528741.780532:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735603328 00000100:00100000:0.0:1788528741.780538:0:24207:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c3a94600 going to sleep for 11 seconds 00000100:00100000:3.0:1788528741.780641:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788528741.780651:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+23:24207:x1875407735603328:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788528741.780768:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+23:24207:x1875407735603328:12345-0@lo:502:mount.lustre.0 Request processed in 118us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528741.780782:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788528741.780869:0:24207:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe693b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:24207:1875407735603328:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788528741.781071:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].1, 224 off8416 00000040:00080000:0.0:1788528741.781096:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].2, 120 off8536 00000040:00080000:0.0:1788528741.781107:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].3, 168 off8704 00000040:00080000:0.0:1788528741.781117:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].4, 224 off8928 00000040:00080000:0.0:1788528741.781128:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].5, 224 off9152 00000040:00080000:0.0:1788528741.781138:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].6, 120 off9272 00000040:00080000:0.0:1788528741.781149:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].7, 168 off9440 00000040:00080000:0.0:1788528741.781161:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].8, 224 off9664 00000040:00080000:0.0:1788528741.781188:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].9, 224 off9888 00000040:00080000:0.0:1788528741.781202:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].10, 120 off10008 00000040:00080000:0.0:1788528741.782328:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].11, 224 off10232 00000040:00080000:0.0:1788528741.782343:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].12, 224 off10456 00000040:00080000:0.0:1788528741.782355:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].13, 88 off10544 00000040:00080000:0.0:1788528741.782367:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].14, 128 off10672 00000040:00080000:0.0:1788528741.782383:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].15, 144 off10816 00000040:00080000:0.0:1788528741.782396:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].16, 160 off10976 00000040:00080000:0.0:1788528741.782408:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].17, 224 off11200 00000040:00080000:0.0:1788528741.782424:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].18, 224 off11424 00000040:00080000:0.0:1788528741.782437:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].19, 80 off11504 00000040:00080000:0.0:1788528741.782450:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].20, 224 off11728 00000040:00080000:0.0:1788528741.782529:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].21, 224 off11952 00000040:00080000:0.0:1788528741.782544:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].22, 88 off12040 00000040:00080000:0.0:1788528741.782874:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].23, 128 off12168 00000040:00080000:0.0:1788528741.782900:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].24, 144 off12312 00000040:00080000:0.0:1788528741.782931:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].25, 160 off12472 00000040:00080000:0.0:1788528741.782948:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].26, 224 off12696 00000040:00080000:0.0:1788528741.782962:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].27, 224 off12920 00000040:00080000:0.0:1788528741.782976:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].28, 80 off13000 00000040:00080000:0.0:1788528741.782991:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].29, 224 off13224 00000040:00080000:0.0:1788528741.783005:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].30, 224 off13448 00000040:00080000:0.0:1788528741.783019:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].31, 88 off13536 00000040:00080000:0.0:1788528741.783032:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].32, 128 off13664 00000040:00080000:0.0:1788528741.783059:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].33, 144 off13808 00000040:00080000:0.0:1788528741.783076:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].34, 128 off13936 00000040:00080000:0.0:1788528741.783091:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].35, 224 off14160 00000040:00080000:0.0:1788528741.783106:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].36, 224 off14384 00000040:00080000:0.0:1788528741.783121:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].37, 80 off14464 00000040:00080000:0.0:1788528741.783137:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].38, 224 off14688 00000040:00080000:0.0:1788528741.783152:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].39, 224 off14912 00000040:00080000:0.0:1788528741.783166:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].40, 88 off15000 00000040:00080000:0.0:1788528741.783195:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].41, 128 off15128 00000040:00080000:0.0:1788528741.783281:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].42, 144 off15272 00000040:00080000:0.0:1788528741.783300:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].43, 128 off15400 00000040:00080000:0.0:1788528741.783315:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].44, 224 off15624 00000040:00080000:0.0:1788528741.783329:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].45, 224 off15848 00000040:00080000:0.0:1788528741.783343:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].46, 80 off15928 00000040:00080000:0.0:1788528741.783356:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].47, 224 off16152 00000040:00080000:0.0:1788528741.783370:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].48, 232 off16384 00000100:00100000:0.0:1788528741.783423:0:24207:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe693b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:24207:1875407735603456:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788528741.783542:0:24207:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528741.783604:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735603456 00000100:00100000:2.0:1788528741.783611:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735603456 00000100:00100000:2.0:1788528741.783654:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788528741.783664:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+23:24207:x1875407735603456:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788528741.783766:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+23:24207:x1875407735603456:12345-0@lo:502:mount.lustre.0 Request processed in 104us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528741.783773:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788528741.783906:0:24207:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c3a94600 going to sleep for 11 seconds 00000100:00100000:0.0:1788528741.783926:0:24207:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe693b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:24207:1875407735603456:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788528741.784097:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].49, 224 off16608 00000040:00080000:0.0:1788528741.784118:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].50, 120 off16728 00000100:00100000:0.0:1788528741.784139:0:24207:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe693b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:24207:1875407735603584:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788528741.784173:0:24207:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528741.784196:0:24207:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c3a94600 going to sleep for 11 seconds 00000100:00100000:3.0:1788528741.784273:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735603584 00000100:00100000:3.0:1788528741.784278:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735603584 00000100:00100000:3.0:1788528741.784317:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788528741.784325:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+23:24207:x1875407735603584:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788528741.784394:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+23:24207:x1875407735603584:12345-0@lo:502:mount.lustre.0 Request processed in 69us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528741.784402:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788528741.784749:0:24207:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe693b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:24207:1875407735603584:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788528741.784787:0:24207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].51, 224 off16952 00000040:00080000:0.0:1788528741.784795:0:24207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788528741.785772:0:24233:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788528741.785799:0:24233:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8a8fc27ce600) 00000020:00000080:2.0:1788528741.785823:0:24233:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1788528741.785996:0:24233:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8a90f6f35800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788528741.786001:0:24233:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8a90f6f35800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788528741.786004:0:24233:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8a90f6f35800 3 00010000:00080000:2.0:1788528741.786032:0:24233:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a8fc33a6800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.138@tcp at head 00010000:00010000:2.0:1788528741.788936:0:24233:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1788528741.789155:0:24233:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788528741.789268:0:24233:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788528741.789283:0:24233:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x892c60dda91c967e 00000100:00080000:2.0:1788528741.789294:0:24233:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788528741.789300:0:24233:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a8fc33a6800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1788528741.789335:0:24233:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90faa09880 x1875407735603712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788528741.789366:0:24233:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788528741.789579:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1875407735603712:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788528741.789901:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528741.790015:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735603712 00000100:00100000:2.0:1788528741.790023:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735603712 00000100:00100000:2.0:1788528741.790068:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788528741.790076:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4677b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1875407735603712:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788528741.790112:0:22705:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 611 last 0 00000020:00000080:2.0:1788528741.790143:0:22705:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x892c60dda91c9685 00000004:00100000:2.0:1788528741.790159:0:22705:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788528741.790188:0:22705:0:(import.c:65:import_set_state_nolock()) ffff8a8fc33a7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788528741.790383:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4677b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875407735603712:12345-0@lo:38:llog_process_th.0 Request processed in 305us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528741.790391:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:2.0:1788528741.790501:0:24233:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788528741.790515:0:24233:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8a8fc27c9980) 00000020:00000080:2.0:1788528741.790530:0:24233:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1788528741.790639:0:24233:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8a90f6f35800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788528741.790660:0:24233:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8a90f6f35800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788528741.790663:0:24233:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8a90f6f35800 3 00010000:00080000:2.0:1788528741.790686:0:24233:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a8fc33a2800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.138@tcp at head 00000100:00100000:0.0:1788528741.791161:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735603840:0@lo:400:kworker.0 00000100:00100000:0.0:1788528741.791213:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788528741.791261:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788528741.791265:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788528741.791268:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788528741.791271:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788528741.791368:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788528741.791376:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875407735603968:0@lo:400:kworker.0 00000100:00100000:0.0:1788528741.791405:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528741.791449:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735603840 00000100:00100000:0.0:1788528741.791455:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735603840 00000100:00100000:0.0:1788528741.791491:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788528741.791498:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735603840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528741.791541:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735603840:12345-0@lo:400:kworker.0 Request processed in 43us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528741.791548:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788528741.791606:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735603840:0@lo:400:kworker.0 00000100:00100000:0.0:1788528741.791839:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735604096:0@lo:400:kworker.0 00000100:00100000:0.0:1788528741.791882:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788528741.791918:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788528741.791922:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788528741.791925:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788528741.791928:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788528741.792021:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788528741.792028:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875407735604224:0@lo:400:kworker.0 00000100:00100000:0.0:1788528741.792074:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528741.792104:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735604096 00000100:00100000:0.0:1788528741.792108:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735604096 00000100:00100000:0.0:1788528741.792132:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788528741.792137:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735604096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528741.792238:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735604096:12345-0@lo:400:kworker.0 Request processed in 100us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528741.792246:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788528741.792267:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735603968 00000100:00100000:0.0:1788528741.792271:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735603968 00000100:00100000:0.0:1788528741.792293:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735604224 00000100:00100000:0.0:1788528741.792295:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735604224 00000100:00100000:0.0:1788528741.792307:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788528741.792312:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875407735603968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528741.792347:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875407735603968:12345-0@lo:400:kworker.0 Request processed in 34us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528741.792353:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788528741.792365:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788528741.792370:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875407735604224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528741.792394:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875407735604224:12345-0@lo:400:kworker.0 Request processed in 24us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528741.792400:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788528741.792503:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a90fa8ae300 x1875407735604224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528741.792513:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875407735604224:0@lo:400:kworker.0 00000100:00100000:0.0:1788528741.792523:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735604096:0@lo:400:kworker.0 00010000:00080000:0.0:1788528741.792575:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a90fa8adf80 x1875407735603968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528741.792584:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875407735603968:0@lo:400:kworker.0 00010000:00010000:2.0:1788528741.792929:0:24233:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1788528741.793404:0:24233:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1788528741.793446:0:24233:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788528741.793463:0:24233:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x892c60dda91c9693 00000100:00080000:2.0:1788528741.793472:0:24233:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788528741.793478:0:24233:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8a8fc33a2800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1788528741.793503:0:24233:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90faa08000 x1875407735604352/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788528741.793516:0:24233:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788528741.793593:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788528741.793599:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788528741.793602:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788528741.793605:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788528741.793607:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788528741.793616:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788528741.793618:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788528741.793621:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1788528741.793927:0:24233:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 52 count 51 00010000:00080000:1.0:1788528741.794311:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a90faa09880 x1875407735603712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788528751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528741.794323:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788528741.794331:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1788528741.794339:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788528741.794343:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788528741.794346:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc33a6800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788528741.794352:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1875407735603712:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788528741.794375:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1875407735604352:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788528741.794424:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1788528741.794818:0:24207:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788528741.794841:0:24207:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788528741.794864:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2a00/0x892c60dda91c9669 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9670 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528741.794876:0:24207:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2a00/0x892c60dda91c9669 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9670 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788528741.794924:0:24207:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788528741.794926:0:24207:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788528741.794927:0:24207:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788528741.794928:0:24207:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788528741.794929:0:24207:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788528741.794931:0:24207:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788528741.794933:0:24207:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788528741.794934:0:24207:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788528741.794936:0:24207:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788528741.794939:0:24207:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788528741.794942:0:24207:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788528741.794944:0:24207:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788528741.794945:0:24207:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788528741.794946:0:24207:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788528741.794947:0:24207:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788528741.794948:0:24207:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788528741.794949:0:24207:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788528741.794950:0:24207:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788528741.794951:0:24207:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788528741.794970:0:24207:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788528741.794983:0:24207:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4675c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:24207:1875407735604480:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788528741.795018:0:24207:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528741.795045:0:24207:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c7849a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788528741.795096:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735604480 00000100:00100000:3.0:1788528741.795103:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735604480 00000100:00100000:3.0:1788528741.795144:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788528741.795153:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+23:24207:x1875407735604480:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788528741.795479:0:22700:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788528741.795494:0:22700:0:(mgs_nids.c:468:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788528741.796820:0:22700:0:(mgs_nids.c:820:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788528741.796832:0:22700:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788528741.797066:0:22721:0:(mgs_nids.c:717:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788528741.797071:0:22721:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788528741.797092:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a90c6c82800/0x892c60dda91c969a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528741.797110:0:22721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a90c6c83600/0x892c60dda91c95dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c95d6 expref: 23 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528741.797118:0:22721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a8fc26e3c00/0x892c60dda91c95eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c95e4 expref: 23 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528741.797125:0:22721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a90c6c82800/0x892c60dda91c969a lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528741.797159:0:22721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a8fc26e3c00/0x892c60dda91c95eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c95e4 expref: 23 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528741.797233:0:22721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a8fc26e3c00/0x892c60dda91c95eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c95e4 expref: 23 pid: 22699 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528741.797255:0:22721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ae680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22721:1875407735604608:0@lo:104: 00000100:00100000:3.0:1788528741.797308:0:22721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788528741.797389:0:22721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a90c6c83600/0x892c60dda91c95dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c95d6 expref: 23 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528741.797398:0:22721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a90c6c83600/0x892c60dda91c95dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c95d6 expref: 23 pid: 22698 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528741.797418:0:22721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8aca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22721:1875407735604736:0@lo:104: 00000100:00100000:3.0:1788528741.797442:0:22721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528741.797576:0:22721:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78cd0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788528741.797642:0:22689:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788528741.797658:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735604608 00000100:00100000:2.0:1788528741.797664:0:22689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735604608 00000100:00100000:2.0:1788528741.797698:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735604736 00000100:00100000:2.0:1788528741.797701:0:22689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735604736 00000100:00100000:2.0:1788528741.797715:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788528741.797723:0:22689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07f6b94a-1259-41bf-8282-a67e1c8aef03+4:22721:x1875407735604608:12345-0@lo:104: 00010000:00010000:2.0:1788528741.797737:0:22689:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a90c784fc00/0x892c60dda91c95e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c95eb expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528741.797790:0:22689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788528741.797796:0:22689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07f6b94a-1259-41bf-8282-a67e1c8aef03+4:22721:x1875407735604608:12345-0@lo:104: Request processed in 74us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528741.797804:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788528741.797820:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788528741.797826:0:22689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f04c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07f6b94a-1259-41bf-8282-a67e1c8aef03+3:22721:x1875407735604736:12345-0@lo:104: 00010000:00010000:2.0:1788528741.797839:0:22689:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3400/0x892c60dda91c95d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c95dd expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528741.797931:0:22688:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/2 left), rc = 0 00000100:00100000:3.0:1788528741.797937:0:22688:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1788528741.797943:0:22688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:3.0:1788528741.798069:0:22721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ae680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22721:1875407735604608:0@lo:104: 00000100:00100000:3.0:1788528741.798121:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+23:24207:x1875407735604480:12345-0@lo:253:mount.lustre.0 Request processed in 2968us (3101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528741.798129:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788528741.798146:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735604352 00000100:00100000:0.0:1788528741.798151:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735604352 00000100:00100000:0.0:1788528741.798174:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788528741.798179:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4676680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1875407735604352:12345-0@lo:38:llog_process_th.0 00010000:00010000:2.0:1788528741.798261:0:22689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788528741.798267:0:22689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f04c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07f6b94a-1259-41bf-8282-a67e1c8aef03+3:22721:x1875407735604736:12345-0@lo:104: Request processed in 441us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528741.798273:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788528741.798307:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788528741.798313:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c784fc00/0x892c60dda91c95e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c95eb expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528741.798320:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c784fc00 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:2.0:1788528741.798324:0:22694:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c784fc00/0x892c60dda91c95e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c95eb expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528741.798333:0:22694:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c784fc00/0x892c60dda91c95e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c95eb expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788528741.798340:0:22694:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c784fc00/0x892c60dda91c95e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c95eb expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528741.798345:0:22694:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00080000:0.0:1788528741.798367:0:22706:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 611 last 0 00010000:00010000:2.0:1788528741.798373:0:22694:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90c784fc00/0x892c60dda91c95e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c95eb expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528741.798379:0:22694:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00000080:0.0:1788528741.798409:0:22706:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x892c60dda91c96a1 00000004:00100000:0.0:1788528741.798423:0:22706:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788528741.798453:0:22706:0:(import.c:65:import_set_state_nolock()) ffff8a8fc253b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788528741.798494:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07f6b94a-1259-41bf-8282-a67e1c8aef03:3639:1875407735604864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788528741.798499:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4676680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875407735604352:12345-0@lo:38:llog_process_th.0 Request processed in 319us (4074us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528741.798505:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788528741.798524:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788528741.798543:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a90faa08000 x1875407735604352/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788528751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788528741.798580:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c784fc00/0x892c60dda91c95e4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c95eb expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528741.798580:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00010000:00010000:2.0:1788528741.798588:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c784fc00/0x892c60dda91c95e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c95eb expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788528741.798588:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1788528741.798596:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788528741.798600:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788528741.798602:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc33a2800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00010000:00010000:2.0:1788528741.798604:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788528741.798608:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3400/0x892c60dda91c95d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c95dd expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528741.798608:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1875407735604352:0@lo:38:llog_process_th.0 00010000:00010000:2.0:1788528741.798614:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc26e3400 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:2.0:1788528741.798617:0:22694:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3400/0x892c60dda91c95d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c95dd expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528741.798624:0:22694:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3400/0x892c60dda91c95d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c95dd expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788528741.798630:0:22694:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3400/0x892c60dda91c95d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c95dd expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528741.798635:0:22694:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788528741.798649:0:22694:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3400/0x892c60dda91c95d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c95dd expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528741.798655:0:22694:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788528741.798746:0:24207:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4675c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:24207:1875407735604480:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788528741.798759:0:24207:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788528741.798762:0:24207:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788528741.798764:0:24207:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788528741.798765:0:24207:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788528741.798767:0:24207:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788528741.798768:0:24207:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788528741.798769:0:24207:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788528741.798771:0:24207:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788528741.798772:0:24207:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788528741.798773:0:24207:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788528741.798788:0:24207:0:(tgt_mount.c:2815:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788528741.799616:0:22690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735604864 00000100:00100000:0.0:1788528741.799623:0:22690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735604864 00010000:00010000:0.0:1788528741.799673:0:22690:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a8fc26e3c00/0x892c60dda91c95eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c95e4 expref: 23 pid: 22699 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528741.799708:0:22690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788528741.799715:0:22690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4676300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07f6b94a-1259-41bf-8282-a67e1c8aef03+23:3639:x1875407735604864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788528741.799727:0:22690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528741.799732:0:22690:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a8fc26e3c00/0x892c60dda91c95eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c95e4 expref: 23 pid: 22699 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528741.799743:0:22690:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a8fc26e3c00/0x892c60dda91c95eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c95e4 expref: 23 pid: 22699 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528741.799758:0:22690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a8fc26e3c00/0x892c60dda91c95eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c95e4 expref: 23 pid: 22699 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528741.799771:0:22690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528741.799811:0:22690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4676300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07f6b94a-1259-41bf-8282-a67e1c8aef03+22:3639:x1875407735604864:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (1286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528741.799817:0:22690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788528741.799934:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07f6b94a-1259-41bf-8282-a67e1c8aef03:3639:1875407735604864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788528741.799946:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788528741.799961:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07f6b94a-1259-41bf-8282-a67e1c8aef03:3639:1875407735604992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788528741.799991:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528741.800130:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735604992 00000100:00100000:0.0:1788528741.800135:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735604992 00010000:00010000:0.0:1788528741.800149:0:22691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a90c6c83600/0x892c60dda91c95dd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c95d6 expref: 22 pid: 22698 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528741.800256:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788528741.800264:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e28450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07f6b94a-1259-41bf-8282-a67e1c8aef03+22:3639:x1875407735604992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788528741.800273:0:22691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528741.800277:0:22691:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a90c6c83600/0x892c60dda91c95dd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c95d6 expref: 22 pid: 22698 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528741.800286:0:22691:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a90c6c83600/0x892c60dda91c95dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c95d6 expref: 22 pid: 22698 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528741.800306:0:22691:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a90c6c82800/0x892c60dda91c969a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528741.800316:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c6c82800/0x892c60dda91c969a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788528741.800333:0:22691:0:(mgs_nids.c:693:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014698143s 00010000:00010000:0.0:1788528741.800340:0:22691:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a90c6c82800/0x892c60dda91c969a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528741.800348:0:22691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a90c6c82800/0x892c60dda91c969a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528741.800356:0:22691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a90c6c82800/0x892c60dda91c969a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528741.800362:0:22691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a90c6c82800/0x892c60dda91c969a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528741.800368:0:22691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c6c82800 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528741.800372:0:22691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a90c6c82800/0x892c60dda91c969a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528741.800379:0:22691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a90c6c82800/0x892c60dda91c969a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528741.800388:0:22691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a90c6c82800/0x892c60dda91c969a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528741.800397:0:22691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528741.800445:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e28450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07f6b94a-1259-41bf-8282-a67e1c8aef03+22:3639:x1875407735604992:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528741.800457:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788528741.800530:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07f6b94a-1259-41bf-8282-a67e1c8aef03:3639:1875407735604992:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788528741.800590:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528741.800610:0:22721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c6c83600/0x892c60dda91c95dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c95d6 expref: 21 pid: 22698 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528741.800621:0:22721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8aca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22721:1875407735604736:0@lo:104: 00010000:00010000:1.0:1788528741.800636:0:22721:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a90c6c82800/0x892c60dda91c969a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528741.800644:0:22721:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a90c6c82800/0x892c60dda91c969a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528741.800651:0:22721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a90c6c82800/0x892c60dda91c969a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528741.800657:0:22721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c6c82800/0x892c60dda91c969a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528741.801137:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3400/0x892c60dda91c95d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c95dd expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528741.801146:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3400/0x892c60dda91c95d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c95dd expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528741.801160:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528741.801162:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528741.801164:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1788528741.803770:0:24207:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1788528741.808546:0:24207:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788528741.808619:0:24207:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788528741.808658:0:24207:0:(tgt_mount.c:2543:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788528741.808679:0:24207:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1788528741.810024:0:24207:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788528741.810317:0:24207:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788528742.590807:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788528742.622292:0:24287:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788528742.623007:0:24287:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788528743.107140:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735605120:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788528743.107245:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528743.107332:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735605120 00000100:00100000:2.0:1788528743.107342:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735605120 00000100:00100000:2.0:1788528743.107401:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788528743.107412:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735605120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788528743.107454:0:22710:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788528743.107515:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735605120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528743.107526:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788528743.107627:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735605120:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788528743.108125:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735605248:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788528743.108162:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528743.108703:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735605248 00000100:00100000:2.0:1788528743.108711:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735605248 00000100:00100000:2.0:1788528743.109285:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788528743.109298:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735605248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788528743.109336:0:22711:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788528743.109402:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735605248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (1239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528743.109411:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788528743.109464:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735605248:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788528743.616907:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788528743.680022:0:22702:0:(mgc_request.c:714:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788528743.680031:0:22702:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-mdtir-ffff8a90f5ac8800 from 13 10000000:01000000:2.0:1788528743.680045:0:22702:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788528743.680100:0:22702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2400/0x892c60dda91c96a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528743.680111:0:22702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2400/0x892c60dda91c96a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528743.680122:0:22702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2400/0x892c60dda91c96a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528743.680147:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735605376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788528743.680211:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528743.680257:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc1c8f840 going to sleep for 11 seconds 00000100:00100000:0.0:1788528743.680325:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735605376 00000100:00100000:0.0:1788528743.680333:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735605376 00000100:00100000:0.0:1788528743.680389:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788528743.680398:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+21:22702:x1875407735605376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788528743.680410:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528743.680424:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9101851200/0x892c60dda91c96af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c96a8 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528743.680446:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9101851200/0x892c60dda91c96af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c96a8 expref: 22 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528743.680457:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9101851200/0x892c60dda91c96af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c96a8 expref: 22 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528743.680465:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101851200, rc 0) 00000100:00100000:0.0:1788528743.680522:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+22:22702:x1875407735605376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528743.680529:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788528743.680845:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735605376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788528743.680972:0:22702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2400/0x892c60dda91c96a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c96af expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528743.680983:0:22702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2400/0x892c60dda91c96a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c96af expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528743.681047:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4676a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735605504:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788528743.681092:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528743.681119:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735605504 00000100:00100000:2.0:1788528743.681125:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735605504 00000100:00100000:1.0:1788528743.681128:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d00e3300 going to sleep for 11 seconds 00000100:00100000:2.0:1788528743.681161:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788528743.681170:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+22:22702:x1875407735605504:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788528743.681196:0:22699:0:(mgs_nids.c:920:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788528743.681213:0:22699:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788528743.681216:0:22699:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1788528743.681298:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+22:22702:x1875407735605504:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 128us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528743.681306:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788528743.681340:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4676a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735605504:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788528743.681398:0:22702:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788528743.681405:0:22702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2400/0x892c60dda91c96a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c96af expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528743.681413:0:22702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2400/0x892c60dda91c96a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c96af expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528743.681429:0:22702:0:(mgc_request.c:714:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788528743.681431:0:22702:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-mdtir-ffff8a90ff704000 from 13 10000000:01000000:2.0:1788528743.681433:0:22702:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788528743.681453:0:22702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3c00/0x892c60dda91c96b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528743.681459:0:22702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3c00/0x892c60dda91c96b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528743.681466:0:22702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3c00/0x892c60dda91c96b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528743.681479:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735605632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788528743.681507:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528743.681523:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc1c8f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788528743.681537:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735605632 00000100:00100000:2.0:1788528743.681540:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735605632 00000100:00100000:2.0:1788528743.681584:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788528743.681591:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5893050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+22:22702:x1875407735605632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788528743.681598:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528743.681607:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a8fc26e3400/0x892c60dda91c96bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c96b6 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528743.681623:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a8fc26e3400/0x892c60dda91c96bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c96b6 expref: 23 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528743.681632:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a8fc26e3400/0x892c60dda91c96bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c96b6 expref: 23 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528743.681650:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a8fc26e3400, rc 0) 00000100:00100000:2.0:1788528743.681679:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5893050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+23:22702:x1875407735605632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528743.681684:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788528743.681712:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735605632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788528743.681720:0:22702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3c00/0x892c60dda91c96b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c96bd expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528743.681727:0:22702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3c00/0x892c60dda91c96b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c96bd expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528743.681761:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735605760:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788528743.681854:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528743.681937:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc1c8f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788528743.681948:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735605760 00000100:00100000:2.0:1788528743.681952:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735605760 00000100:00100000:2.0:1788528743.681974:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788528743.681980:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5892050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+23:22702:x1875407735605760:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788528743.681990:0:22698:0:(mgs_nids.c:920:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788528743.682001:0:22698:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788528743.682004:0:22698:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1788528743.682099:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5892050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+23:22702:x1875407735605760:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 119us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528743.682106:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788528743.682814:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735605760:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788528743.682883:0:22702:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788528743.682892:0:22702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3c00/0x892c60dda91c96b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c96bd expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528743.682905:0:22702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3c00/0x892c60dda91c96b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c96bd expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788528744.194782:0:22740:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788528744.638753:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528745.663042:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528746.690008:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788528747.199863:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788528747.199870:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788528747.199872:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788528747.199875:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788528747.199900:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788528747.199904:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788528747.199907:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788528747.199911:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788528747.199953:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875407735606144:0@lo:400:kworker.0 00000100:00100000:3.0:1788528747.200034:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528747.200068:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1875407735606656:0@lo:400:kworker.0 00000100:00100000:3.0:1788528747.200094:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528747.200116:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788528747.200122:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735606272:0@lo:400:kworker.0 00000100:00100000:3.0:1788528747.200146:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528747.200198:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735606144 00000100:00100000:1.0:1788528747.200322:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07f6b94a-1259-41bf-8282-a67e1c8aef03:3639:1875407735605888:0@lo:400:kworker.0 00000100:00100000:1.0:1788528747.200371:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528747.200395:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875407735606400:0@lo:400:kworker.0 00000100:00100000:1.0:1788528747.200418:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528747.200433:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788528747.200438:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735606016:0@lo:400:kworker.0 00000100:00100000:1.0:1788528747.200458:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528747.200477:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1875407735606528:0@lo:400:kworker.0 00000100:00100000:1.0:1788528747.200497:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528747.200517:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735606272 00000100:00100000:1.0:1788528747.200523:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735606272 00000100:00100000:1.0:1788528747.200582:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735606016 00000100:00100000:1.0:1788528747.200587:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735606016 00000100:00100000:1.0:1788528747.200603:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788528747.200783:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735606656 00000100:00100000:0.0:1788528747.200789:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735606656 00000100:00100000:0.0:1788528747.200824:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735606400 00000100:00100000:0.0:1788528747.200827:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735606400 00000100:00100000:0.0:1788528747.200840:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735606528 00000100:00100000:0.0:1788528747.200842:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735606528 00000100:00100000:0.0:1788528747.200855:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788528747.200862:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875407735606656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528747.200915:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875407735606656:12345-0@lo:400:kworker.0 Request processed in 53us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528747.200922:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788528747.200941:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788528747.200947:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4676d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875407735606400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528747.200980:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4676d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875407735606400:12345-0@lo:400:kworker.0 Request processed in 33us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528747.200986:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788528747.200997:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788528747.201002:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4677800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875407735606528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528747.201042:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4677800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875407735606528:12345-0@lo:400:kworker.0 Request processed in 40us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528747.201047:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788528747.201079:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735605888 00000100:00100000:0.0:1788528747.201083:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735605888 00000100:00100000:0.0:1788528747.201109:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788528747.201116:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5890450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+23:3639:x1875407735605888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528747.201145:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5890450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+23:3639:x1875407735605888:12345-0@lo:400:kworker.0 Request processed in 31us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528747.201151:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788528747.201398:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735606272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528747.201436:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735606272:12345-0@lo:400:kworker.0 Request processed in 825us (1289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528747.201442:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788528747.201459:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788528747.201465:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4674700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735606016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528747.201489:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4674700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735606016:12345-0@lo:400:kworker.0 Request processed in 25us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528747.201494:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1788528747.201530:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788528747.201534:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788528747.201706:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735606144 00000100:00100000:3.0:1788528747.201742:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788528747.201750:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875407735606144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528747.201781:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875407735606144:12345-0@lo:400:kworker.0 Request processed in 34us (1749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528747.201794:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788528747.201837:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735606272:0@lo:400:kworker.0 00010000:00080000:3.0:1788528747.201850:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90fa8ace00 x1875407735606144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528747.201861:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875407735606144:0@lo:400:kworker.0 00010000:00080000:3.0:1788528747.201871:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90fa8ad180 x1875407735606656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528747.201879:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1875407735606656:0@lo:400:kworker.0 00010000:00080000:0.0:1788528747.202485:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90fa8ad880 x1875407735606528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528747.202498:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1875407735606528:0@lo:400:kworker.0 00000100:00100000:0.0:1788528747.202516:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07f6b94a-1259-41bf-8282-a67e1c8aef03:3639:1875407735605888:0@lo:400:kworker.0 00010000:00080000:0.0:1788528747.202528:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90fa8aea00 x1875407735606400/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528747.202535:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875407735606400:0@lo:400:kworker.0 00000100:00100000:0.0:1788528747.202700:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735606016:0@lo:400:kworker.0 00010000:00010000:3.0:1788528747.714389:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788528747.770440:0:24578:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788528748.222925:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788528748.222945:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735606784:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788528748.223015:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528748.223056:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735606784 00000100:00100000:2.0:1788528748.223064:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735606784 00000100:00100000:2.0:1788528748.223108:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788528748.223116:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735606784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788528748.223147:0:22711:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788528748.223188:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735606784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528748.223194:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788528748.223234:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735606784:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788528748.223424:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735606912:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788528748.223454:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528748.223588:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735606912 00000100:00100000:0.0:1788528748.223593:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735606912 00000100:00100000:0.0:1788528748.223627:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788528748.223634:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4675f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735606912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788528748.223653:0:23449:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788528748.223689:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4675f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735606912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528748.223695:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788528748.223724:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735606912:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788528748.735653:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788528748.762187:0:24630:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788528748.762400:0:24630:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:0.0:1788528749.377906:0:23462:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:3.0:1788528749.594492:0:24680:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788528749.595829:0:24680:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788528749.759380:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528750.790159:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528751.806843:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528752.063627:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788528737/real 1788528737] req@ffff8a90fe690000 x1875407735600512/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788528752 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528752.063658:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a90fe690000 x1875407735600512/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788528752 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528752.063669:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788528737/real 1788528737] req@ffff8a90fe690700 x1875407735600640/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788528752 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528752.063682:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a90fe690700 x1875407735600640/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788528752 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788528752.063702:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3d0d000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788528752.063722:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788528752.063725:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735600512:0@lo:8:kworker.0 00000100:00080000:2.0:1788528752.063731:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1d14800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788528752.063744:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788528752.063747:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735600640:0@lo:8:kworker.0 00000100:00080000:2.0:1788528752.063831:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788528752.063834:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788528752.063836:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788528752.063838:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788528752.063850:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788528752.063852:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788528752.063853:0:469:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3d0d000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788528752.063857:0:469:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 607 00000100:00080000:2.0:1788528752.063862:0:469:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788528752.063867:0:469:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8a8fc3d0d000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1788528752.063892:0:469:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90faa0bb80 x1875407735607552/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788528752.063905:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788528752.063909:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788528752.063911:0:469:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1d14800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788528752.063914:0:469:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 607 00000100:00080000:2.0:1788528752.063918:0:469:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788528752.063922:0:469:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a8fc1d14800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1788528752.063935:0:469:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90faa09180 x1875407735607680/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788528752.064065:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07f6b94a-1259-41bf-8282-a67e1c8aef03:3640:1875407735607040:0@lo:400:kworker.0 00000100:00100000:2.0:1788528752.064148:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528752.064204:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735607808:0@lo:400:kworker.0 00000100:00100000:2.0:1788528752.064241:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528752.064266:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788528752.064274:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735607424:0@lo:400:kworker.0 00000100:00100000:2.0:1788528752.064302:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528752.064328:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735607168:0@lo:400:kworker.0 00000100:00100000:2.0:1788528752.064352:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528752.064375:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1875407735607936:0@lo:400:kworker.0 00000100:00100000:2.0:1788528752.064400:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528752.064420:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788528752.064425:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875407735607296:0@lo:400:kworker.0 00000100:00100000:2.0:1788528752.064444:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528752.067364:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735607808 00000100:00100000:0.0:1788528752.067378:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735607808 00000100:00100000:0.0:1788528752.067709:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735607936 00000100:00100000:0.0:1788528752.067714:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735607936 00000100:00100000:2.0:1788528752.067727:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6bc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1875407735608064:0@lo:400:kworker.0 00000100:00100000:0.0:1788528752.067745:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735607296 00000100:00100000:0.0:1788528752.067749:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735607296 00000100:00100000:0.0:1788528752.067768:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788528752.067778:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735607808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528752.067788:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528752.067847:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735607808:12345-0@lo:400:kworker.0 Request processed in 70us (3605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528752.067856:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788528752.067871:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735608064 00000100:00100000:0.0:1788528752.067874:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735608064 00000100:00100000:0.0:1788528752.067891:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788528752.067896:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6bc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875407735607936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528752.067935:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6bc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875407735607936:12345-0@lo:400:kworker.0 Request processed in 38us (3534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528752.067941:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788528752.067954:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788528752.067962:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6bca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875407735607296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528752.068006:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6bca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875407735607296:12345-0@lo:400:kworker.0 Request processed in 46us (3561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528752.068023:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788528752.068036:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788528752.068043:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6bcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875407735608064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528752.068071:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6bcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875407735608064:12345-0@lo:400:kworker.0 Request processed in 30us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528752.068076:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788528752.068097:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735607424 00000100:00100000:0.0:1788528752.068826:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735607424 00000100:00100000:0.0:1788528752.068877:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735607168 00000100:00100000:0.0:1788528752.068882:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735607168 00000100:00100000:0.0:1788528752.068900:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788528752.068907:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6bcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735607424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528752.068951:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6bcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735607424:12345-0@lo:400:kworker.0 Request processed in 46us (4648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528752.068958:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788528752.068969:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788528752.068988:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6bcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735607168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528752.069013:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6bcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735607168:12345-0@lo:400:kworker.0 Request processed in 39us (4661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528752.069019:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788528752.069072:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735607424:0@lo:400:kworker.0 00010000:00080000:0.0:1788528752.069087:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90faa09880 x1875407735607808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528752.069097:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735607808:0@lo:400:kworker.0 00010000:00080000:0.0:1788528752.069437:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90faa0ad80 x1875407735607296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528752.069456:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875407735607296:0@lo:400:kworker.0 00010000:00080000:0.0:1788528752.069472:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90f6bc8e00 x1875407735608064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528752.069480:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6bc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1875407735608064:0@lo:400:kworker.0 00000100:00100000:0.0:1788528752.069490:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735607168:0@lo:400:kworker.0 00010000:00080000:0.0:1788528752.069500:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90faa08000 x1875407735607936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528752.069507:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1875407735607936:0@lo:400:kworker.0 00000100:00080000:1.0:1788528752.069910:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788528752.069916:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788528752.071339:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735607040 00000100:00100000:2.0:1788528752.071350:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735607040 00000100:00100000:2.0:1788528752.071406:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788528752.071416:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5891050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+23:3640:x1875407735607040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528752.071496:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5891050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+23:3640:x1875407735607040:12345-0@lo:400:kworker.0 Request processed in 82us (7349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528752.071505:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788528752.073352:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735607552:0@lo:8:kworker.0 00000100:00100000:2.0:1788528752.073418:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528752.073642:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735607680:0@lo:8:kworker.0 00000100:00100000:2.0:1788528752.073681:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528752.073743:0:24213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735607552 00000100:00100000:2.0:1788528752.073750:0:24213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735607552 00000100:00100000:2.0:1788528752.073834:0:24213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735607680 00000100:00100000:2.0:1788528752.073839:0:24213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735607680 00000100:00100000:3.0:1788528752.073881:0:24214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788528752.073888:0:24214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6bc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3636:x1875407735607552:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788528752.073919:0:24214:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 621 last 0 00000020:00000080:3.0:1788528752.073948:0:24214:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x892c60dda91c96c4 00002000:00100000:3.0:1788528752.073963:0:24214:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8a9101c96800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1788528752.073967:0:24214:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1788528752.073970:0:24214:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788528752.074144:0:24214:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1788528752.074166:0:24214:0:(import.c:65:import_set_state_nolock()) ffff8a9101c93800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788528752.074217:0:24214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6bc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3636:x1875407735607552:12345-0@lo:8:kworker.0 Request processed in 328us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528752.074225:0:24214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788528752.074250:0:24214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788528752.074255:0:24214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6bcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3636:x1875407735607680:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788528752.074267:0:24214:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788528752.079746:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07f6b94a-1259-41bf-8282-a67e1c8aef03:3640:1875407735607040:0@lo:400:kworker.0 00010000:00080000:2.0:1788528752.079819:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90faa0bb80 x1875407735607552/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788528772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528752.079830:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788528752.079839:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788528752.079848:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788528752.079854:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788528752.079857:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3d0d000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788528752.079877:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788528752.079883:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735607552:0@lo:8:kworker.0 00000004:00080000:0.0:1788528752.080009:0:23448:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788528752.080036:0:23448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe690a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23448:1875407735608320:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1788528752.080107:0:23448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528752.080136:0:23448:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78f0000 going to sleep for 11 seconds 00000100:00100000:0.0:1788528752.080156:0:24212:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788528752.080162:0:24212:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788528752.080222:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735608192:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788528752.080255:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788528752.080570:0:23447:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788528752.080654:0:23447:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 621298099352ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788528752.080660:0:23447:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788528752.080704:0:24215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735608192 00000100:00100000:1.0:1788528752.080711:0:24215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735608192 00000100:00100000:1.0:1788528752.080772:0:24215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788528752.080782:0:24216:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1788528752.080782:0:24215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3639:x1875407735608192:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788528752.080788:0:24216:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:1.0:1788528752.080809:0:24215:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788528752.080859:0:24215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3639:x1875407735608192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528752.080866:0:24215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788528752.080886:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788528752.083068:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90fe692300 x1875407735608192/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528768 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528752.083094:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735608192:0@lo:13:osp-pre-0-1.0 00000004:00080000:0.0:1788528752.085109:0:23439:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1788528752.088216:0:24212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735608320 00000100:00100000:0.0:1788528752.088227:0:24212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735608320 00000100:00100000:2.0:1788528752.088365:0:24794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788528752.088377:0:24794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23448:x1875407735608320:12345-0@lo:7:osp-pre-0-1.0 00002000:00080000:0.0:1788528752.090481:0:24794:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788528752.090490:0:24794:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1788528752.090597:0:24794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23448:x1875407735608320:12345-0@lo:7:osp-pre-0-1.0 Request processed in 2219us (10496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528752.090608:0:24794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788528752.091713:0:23448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90fe690a80 x1875407735608320/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788528768 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528752.091730:0:23448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe690a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23448:1875407735608320:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1788528752.091746:0:23448:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:1.0:1788528752.091791:0:23448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4677480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23448:1875407735608448:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788528752.091848:0:23448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528752.091877:0:23448:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d00e3900 going to sleep for 11 seconds 00000100:00100000:0.0:1788528752.091919:0:24212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735608448 00000100:00100000:0.0:1788528752.091927:0:24212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735608448 00000100:00100000:0.0:1788528752.091991:0:24212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788528752.092001:0:24212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4675880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23448:x1875407735608448:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788528752.092028:0:24212:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1788528752.092074:0:24212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4675880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23448:x1875407735608448:12345-0@lo:5:osp-pre-0-1.0 Request processed in 75us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528752.092081:0:24212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788528752.092156:0:23448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a8fc4677480 x1875407735608448/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788528768 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528752.092166:0:23448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4677480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23448:1875407735608448:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1788528752.092175:0:23448:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1788528752.092199:0:23448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4677480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23448:1875407735608576:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788528752.092221:0:23448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528752.092244:0:23448:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d00e3900 going to sleep for 11 seconds 00000100:00100000:0.0:1788528752.092259:0:24794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735608576 00000100:00100000:0.0:1788528752.092262:0:24794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735608576 00000100:00100000:0.0:1788528752.092295:0:24794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788528752.092302:0:24794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4677100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23448:x1875407735608576:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788528752.092328:0:24794:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:3.0:1788528752.104065:0:24214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6bcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3636:x1875407735607680:12345-0@lo:8:kworker.0 Request processed in 29801us (30377us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788528752.104078:0:24214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788528752.104357:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1d14800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788528752.104363:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788528752.104368:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735607680:0@lo:8:kworker.0 00000001:00080000:0.0:1788528752.125198:0:24208:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:0.0:1788528752.125213:0:24208:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1788528752.125737:0:24794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4677100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23448:x1875407735608576:12345-0@lo:5:osp-pre-0-1.0 Request processed in 33431us (33510us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788528752.125749:0:24794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788528752.127955:0:23448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a8fc4677480 x1875407735608576/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788528768 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528752.127970:0:23448:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1788528752.127985:0:23448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4677480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23448:1875407735608576:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1788528752.128005:0:23448:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:1.0:1788528752.128053:0:23448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4677480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23448:1875407735608704:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788528752.128228:0:23448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528752.128296:0:23448:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d00e3900 going to sleep for 11 seconds 00000100:00100000:0.0:1788528752.128407:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735608704 00000100:00100000:0.0:1788528752.128413:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735608704 00000100:00100000:0.0:1788528752.128469:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788528752.128478:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4675180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23448:x1875407735608704:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788528752.128829:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4675180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23448:x1875407735608704:12345-0@lo:900:osp-pre-0-1.0 Request processed in 351us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528752.128838:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788528752.130061:0:23448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a8fc4677480 x1875407735608704/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788528768 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528752.130078:0:23448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4677480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23448:1875407735608704:0@lo:900:osp-pre-0-1.0 00010000:00010000:2.0:1788528752.836603:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528753.344574:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4677480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735608832:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788528753.344644:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528753.344702:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735608832 00000100:00100000:1.0:1788528753.344718:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735608832 00000100:00100000:1.0:1788528753.344763:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788528753.344772:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4676a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735608832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788528753.344805:0:23449:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788528753.344849:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4676a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735608832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528753.344856:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788528753.344915:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4677480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735608832:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788528753.348550:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788528753.348592:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6bc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735608960:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788528753.348654:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528753.348710:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735608960 00000100:00100000:2.0:1788528753.348718:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735608960 00000100:00100000:2.0:1788528753.348768:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788528753.348777:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6bcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735608960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788528753.348808:0:22710:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788528753.348852:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6bcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735608960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528753.348859:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788528753.349091:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6bc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735608960:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788528753.854794:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788528754.432584:0:22740:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788528754.881310:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528755.903974:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788528756.135791:0:25027:0:(obd_mount.c:925:lmd_print()) mount data: 00000020:01000004:2.0:1788528756.135794:0:25027:0:(obd_mount.c:928:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788528756.135796:0:25027:0:(obd_mount.c:931:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788528756.136273:0:25027:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a8fc4779000 00000020:01000004:2.0:1788528756.136287:0:25027:0:(tgt_mount.c:2585:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788528756.136301:0:25027:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788528756.136314:0:25027:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8a8fc27ccc80) 00000020:00000080:2.0:1788528756.136330:0:25027:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788528756.189617:0:25027:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788528756.193818:0:25027:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788528756.194202:0:25027:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788528756.194419:0:25027:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788528756.194698:0:25027:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788528756.194903:0:25027:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788528756.195111:0:25027:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:2.0:1788528756.195993:0:25027:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788528756.196194:0:25027:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788528756.196207:0:25027:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788528756.196218:0:25027:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x892c60dda91c96d2 00000020:01000004:2.0:1788528756.196224:0:25027:0:(tgt_mount.c:2670:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788528756.196248:0:25027:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.138@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788528756.196251:0:25027:0:(mgc_request.c:1317:mgc_set_info_async()) InitRecov MGC192.168.203.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788528756.196257:0:25027:0:(tgt_mount.c:1882:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788528756.196287:0:25027:0:(tgt_mount.c:1482:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.138@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788528756.196291:0:25027:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788528756.196292:0:25027:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788528756.196294:0:25027:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788528756.196295:0:25027:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788528756.196297:0:25027:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788528756.196298:0:25027:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788528756.196300:0:25027:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788528756.196301:0:25027:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788528756.196303:0:25027:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788528756.196306:0:25027:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788528756.196308:0:25027:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788528756.196309:0:25027:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788528756.196310:0:25027:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788528756.196311:0:25027:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788528756.196312:0:25027:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788528756.196314:0:25027:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788528756.196315:0:25027:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788528756.196316:0:25027:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788528756.196317:0:25027:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788528756.196342:0:25027:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788528756.196360:0:25027:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6bc8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:25027:1875407735609088:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788528756.196421:0:25027:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528756.196477:0:25027:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d00e3300 going to sleep for 11 seconds 00000100:00100000:0.0:1788528756.196725:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735609088 00000100:00100000:0.0:1788528756.196734:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735609088 00000100:00100000:0.0:1788528756.196778:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788528756.196786:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5893c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+23:25027:x1875407735609088:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788528756.196831:0:22698:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788528756.196834:0:22698:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788528756.196837:0:22698:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788528756.197248:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5893c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+23:25027:x1875407735609088:12345-0@lo:253:mount.lustre.0 Request processed in 460us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528756.197256:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788528756.197355:0:25027:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6bc8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:25027:1875407735609088:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788528756.197366:0:25027:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788528756.197368:0:25027:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788528756.197369:0:25027:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788528756.197370:0:25027:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788528756.197371:0:25027:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788528756.197372:0:25027:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788528756.197373:0:25027:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788528756.197374:0:25027:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788528756.197376:0:25027:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788528756.197377:0:25027:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788528756.197394:0:25027:0:(tgt_mount.c:115:server_register_mount()) register mount ffff8a8fc4779000 from lustre-OST0001 10000000:01000000:3.0:1788528756.197433:0:25027:0:(mgc_request.c:2207:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788528756.197435:0:25027:0:(mgc_request.c:423:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788528756.197443:0:25027:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8a8fc4779000 10000000:01000000:3.0:1788528756.197449:0:25027:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788528756.197468:0:25027:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.203.138@tcp: setup lustre-OST0001-osd 00000040:01000000:2.0:1788528756.202484:0:25027:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 1 is initialized 00000040:01000000:2.0:1788528756.207292:0:25027:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 10000000:01000000:2.0:1788528756.207315:0:25027:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-sptlrpc-ffff8a8fc4779000 from 1 10000000:01000000:2.0:1788528756.207325:0:25027:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788528756.207362:0:25027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2000/0x892c60dda91c96d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528756.207374:0:25027:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2000/0x892c60dda91c96d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528756.207384:0:25027:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2000/0x892c60dda91c96d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528756.207406:0:25027:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6bcbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:25027:1875407735609216:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788528756.207470:0:25027:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528756.207588:0:25027:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d00e3300 going to sleep for 11 seconds 00000100:00100000:0.0:1788528756.207731:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735609216 00000100:00100000:0.0:1788528756.207739:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735609216 00000100:00100000:1.0:1788528756.207883:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788528756.207893:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5890050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+23:25027:x1875407735609216:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788528756.207904:0:22700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528756.207917:0:22700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c784f000/0x892c60dda91c96e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c96d9 expref: -99 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528756.207939:0:22700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c784f000/0x892c60dda91c96e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c96d9 expref: 24 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528756.207961:0:22700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c784f000/0x892c60dda91c96e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c96d9 expref: 24 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528756.207970:0:22700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c784f000, rc 0) 00000100:00100000:1.0:1788528756.208016:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5890050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+24:25027:x1875407735609216:12345-0@lo:101:mount.lustre.0 Request processed in 125us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528756.208022:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788528756.208097:0:25027:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6bcbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:25027:1875407735609216:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788528756.208112:0:25027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2000/0x892c60dda91c96d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c96e0 expref: -99 pid: 25027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528756.208121:0:25027:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2000/0x892c60dda91c96d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c96e0 expref: -99 pid: 25027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528756.208193:0:25027:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6bcbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:25027:1875407735609344:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788528756.208217:0:25027:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528756.208415:0:25027:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d00e3300 going to sleep for 11 seconds 00000100:00100000:0.0:1788528756.208486:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735609344 00000100:00100000:0.0:1788528756.208491:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735609344 00000100:00100000:0.0:1788528756.208523:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788528756.208530:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5892850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+24:25027:x1875407735609344:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788528756.208617:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5892850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+24:25027:x1875407735609344:12345-0@lo:501:mount.lustre.0 Request processed in 87us (398us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788528756.208624:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788528756.208701:0:25027:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6bcbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:25027:1875407735609344:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788528756.208713:0:25027:0:(mgc_request_server.c:748:mgc_llog_local_copy()) MGC192.168.203.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:2.0:1788528756.208741:0:25027:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6bcbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:25027:1875407735609472:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788528756.208763:0:25027:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528756.208801:0:25027:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d00e3300 going to sleep for 11 seconds 00000100:00100000:0.0:1788528756.208905:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735609472 00000100:00100000:0.0:1788528756.208909:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735609472 00000100:00100000:0.0:1788528756.208927:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788528756.208932:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5892450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+24:25027:x1875407735609472:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788528756.208994:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5892450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+24:25027:x1875407735609472:12345-0@lo:501:mount.lustre.0 Request processed in 61us (230us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788528756.209000:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788528756.209059:0:25027:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6bcbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:25027:1875407735609472:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788528756.209089:0:25027:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788528756.209106:0:25027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2000/0x892c60dda91c96d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c96e0 expref: -99 pid: 25027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528756.209116:0:25027:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2000/0x892c60dda91c96d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c96e0 expref: -99 pid: 25027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528756.209128:0:25027:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff8a8fc4779000 10000000:01000000:2.0:1788528756.209133:0:25027:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788528756.209175:0:25027:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.203.138@tcp: setup lustre-OST0001-osd 00000040:01000000:2.0:1788528756.209241:0:25027:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 1 is initialized 00000040:01000000:2.0:1788528756.209248:0:25027:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 10000000:01000000:2.0:1788528756.209257:0:25027:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788528756.209260:0:25027:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788528756.209275:0:25027:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.203.138@tcp: setup lustre-OST0001-osd 00000040:01000000:2.0:1788528756.209300:0:25027:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 1 is initialized 00000040:01000000:2.0:1788528756.209304:0:25027:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 10000000:01000000:2.0:1788528756.209309:0:25027:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788528756.209311:0:25027:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788528756.209329:0:25027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3000/0x892c60dda91c96e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528756.209337:0:25027:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3000/0x892c60dda91c96e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528756.209344:0:25027:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3000/0x892c60dda91c96e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528756.209356:0:25027:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6bcbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:25027:1875407735609600:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788528756.209390:0:25027:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528756.209403:0:25027:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ee4180 going to sleep for 11 seconds 00000100:00100000:0.0:1788528756.209635:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735609600 00000100:00100000:0.0:1788528756.209640:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735609600 00000100:00100000:0.0:1788528756.209658:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788528756.209664:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5893450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+24:25027:x1875407735609600:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788528756.209670:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528756.209687:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9101850000/0x892c60dda91c96ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c96e7 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528756.209704:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9101850000/0x892c60dda91c96ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c96e7 expref: 25 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528756.209714:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9101850000/0x892c60dda91c96ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c96e7 expref: 25 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528756.209722:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9101850000, rc 0) 00000100:00100000:0.0:1788528756.209757:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5893450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+25:25027:x1875407735609600:12345-0@lo:101:mount.lustre.0 Request processed in 93us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528756.209762:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788528756.209820:0:25027:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6bcbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:25027:1875407735609600:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788528756.209831:0:25027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3000/0x892c60dda91c96e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c96ee expref: -99 pid: 25027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528756.209839:0:25027:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3000/0x892c60dda91c96e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c96ee expref: -99 pid: 25027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788528756.211019:0:25027:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 11 count 11 00000040:00080000:2.0:1788528756.211699:0:25027:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788528756.213798:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].1, 224 off8416 00000040:00080000:2.0:1788528756.213845:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].2, 128 off8544 00000040:00080000:2.0:1788528756.213859:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].3, 112 off8656 00000040:00080000:2.0:1788528756.213871:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].4, 224 off8880 00000040:00080000:2.0:1788528756.213886:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].5, 224 off9104 00000040:00080000:2.0:1788528756.213900:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].6, 80 off9184 00000040:00080000:2.0:1788528756.213912:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].7, 224 off9408 00000040:00080000:2.0:1788528756.213944:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].8, 224 off9632 00000040:00080000:2.0:1788528756.213971:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].9, 120 off9752 00000040:00080000:2.0:1788528756.213994:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].10, 224 off9976 00000040:00080000:2.0:1788528756.213999:0:25027:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 10 count 11 00000100:00100000:2.0:1788528756.214313:0:25027:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6bcbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:25027:1875407735609728:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788528756.214379:0:25027:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528756.214469:0:25027:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528756.215237:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735609728 00000100:00100000:0.0:1788528756.215249:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735609728 00000100:00100000:0.0:1788528756.215312:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788528756.215321:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5891850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+25:25027:x1875407735609728:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788528756.215471:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5891850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+25:25027:x1875407735609728:12345-0@lo:501:mount.lustre.0 Request processed in 150us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528756.215479:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788528756.215606:0:25027:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6bcbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:25027:1875407735609728:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788528756.215642:0:25027:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6bcbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:25027:1875407735609856:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788528756.215688:0:25027:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528756.215717:0:25027:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ee49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528756.215764:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735609856 00000100:00100000:0.0:1788528756.215768:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735609856 00000100:00100000:0.0:1788528756.215798:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788528756.215805:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5891c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+25:25027:x1875407735609856:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788528756.216686:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5891c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+25:25027:x1875407735609856:12345-0@lo:503:mount.lustre.0 Request processed in 878us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528756.216696:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788528756.216798:0:25027:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6bcbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:25027:1875407735609856:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788528756.217297:0:25027:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788528756.217365:0:25027:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6bcbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:25027:1875407735609984:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788528756.217410:0:25027:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528756.217439:0:25027:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ee4180 going to sleep for 11 seconds 00000100:00100000:0.0:1788528756.217505:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735609984 00000100:00100000:0.0:1788528756.217527:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735609984 00000100:00100000:0.0:1788528756.217587:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788528756.217595:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5893850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+25:25027:x1875407735609984:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788528756.218255:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5893850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+25:25027:x1875407735609984:12345-0@lo:502:mount.lustre.0 Request processed in 658us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528756.218263:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788528756.218351:0:25027:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6bcbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:25027:1875407735609984:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788528756.218546:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].1, 224 off8416 00000040:00080000:2.0:1788528756.218608:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].2, 128 off8544 00000040:00080000:2.0:1788528756.218625:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].3, 112 off8656 00000040:00080000:2.0:1788528756.218640:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].4, 224 off8880 00000040:00080000:2.0:1788528756.218653:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].5, 224 off9104 00000040:00080000:2.0:1788528756.218664:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].6, 80 off9184 00000040:00080000:2.0:1788528756.218676:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].7, 224 off9408 00000040:00080000:2.0:1788528756.218687:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].8, 224 off9632 00000040:00080000:2.0:1788528756.218698:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].9, 120 off9752 00000100:00100000:2.0:1788528756.218722:0:25027:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6bcbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:25027:1875407735610112:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788528756.218759:0:25027:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528756.218781:0:25027:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ee4180 going to sleep for 11 seconds 00000100:00100000:0.0:1788528756.218889:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735610112 00000100:00100000:0.0:1788528756.218895:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735610112 00000100:00100000:0.0:1788528756.218983:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788528756.218992:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5890850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+25:25027:x1875407735610112:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788528756.219090:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5890850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+25:25027:x1875407735610112:12345-0@lo:502:mount.lustre.0 Request processed in 99us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528756.219097:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788528756.219168:0:25027:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6bcbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:25027:1875407735610112:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788528756.219206:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].10, 224 off9976 00000040:00080000:2.0:1788528756.219214:0:25027:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1788528756.220049:0:25031:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788528756.220058:0:25031:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1788528756.220064:0:25031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788528756.220076:0:25031:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788528756.220082:0:25031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788528756.220094:0:25031:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8a8fc27c8000) 00000020:00000080:2.0:1788528756.220119:0:25031:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788528756.220126:0:25031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788528756.220314:0:25031:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8a8fc4779000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788528756.220322:0:25031:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788528756.220329:0:25031:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x892c60dda91c96fc 00010000:00010000:1.0:1788528756.225030:0:25031:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1788528756.225628:0:25031:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:1.0:1788528756.227052:0:25031:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/32) registered 00000020:00000080:1.0:1788528756.228526:0:25031:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788528756.228537:0:25031:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788528756.228543:0:25031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528756.228545:0:25031:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788528756.228578:0:25031:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788528756.228583:0:25031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528756.228585:0:25031:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788528756.228588:0:25031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788528756.228590:0:25031:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788528756.228592:0:25031:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788528756.228595:0:25031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528756.228596:0:25031:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788528756.228599:0:25031:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788528756.228601:0:25031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528756.228603:0:25031:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788528756.228606:0:25031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788528756.228629:0:25031:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788528756.228632:0:25031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788528756.228633:0:25031:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788528756.228636:0:25031:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 11 count 11 00000020:01000000:2.0:1788528756.228805:0:25027:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788528756.228819:0:25027:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788528756.228832:0:25027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3000/0x892c60dda91c96e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c96ee expref: -99 pid: 25027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528756.228843:0:25027:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3000/0x892c60dda91c96e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c96ee expref: -99 pid: 25027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528756.228851:0:25027:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff8a8fc4779000 from 1 10000000:01000000:2.0:1788528756.228854:0:25027:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788528756.228888:0:25027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3600/0x892c60dda91c9703 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528756.228896:0:25027:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3600/0x892c60dda91c9703 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528756.228907:0:25027:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3600/0x892c60dda91c9703 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528756.228930:0:25027:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6bcbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:25027:1875407735610240:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788528756.229012:0:25027:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528756.229055:0:25027:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ee4480 going to sleep for 11 seconds 00000100:00100000:1.0:1788528756.229281:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735610240 00000100:00100000:1.0:1788528756.229288:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735610240 00000100:00100000:1.0:1788528756.229341:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788528756.229351:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5890c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+25:25027:x1875407735610240:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788528756.229363:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528756.229376:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c784fa00/0x892c60dda91c970a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c9703 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528756.229399:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c784fa00/0x892c60dda91c970a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c9703 expref: 26 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528756.229409:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c784fa00/0x892c60dda91c970a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c9703 expref: 26 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528756.229424:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c784fa00, rc 0) 00000100:00100000:1.0:1788528756.229476:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5890c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+26:25027:x1875407735610240:12345-0@lo:101:mount.lustre.0 Request processed in 126us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528756.229483:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788528756.229597:0:25027:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6bcbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:25027:1875407735610240:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788528756.229613:0:25027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3600/0x892c60dda91c9703 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c970a expref: -99 pid: 25027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528756.229622:0:25027:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3600/0x892c60dda91c9703 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c970a expref: -99 pid: 25027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788528756.230918:0:25027:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 13 count 13 00000040:00080000:0.0:1788528756.231295:0:25027:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788528756.231473:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].1, 224 off8416 00000040:00080000:0.0:1788528756.231494:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].2, 112 off8528 00000040:00080000:0.0:1788528756.231507:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].3, 224 off8752 00000040:00080000:0.0:1788528756.231531:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].4, 224 off8976 00000040:00080000:0.0:1788528756.231548:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].5, 112 off9088 00000040:00080000:0.0:1788528756.231716:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].6, 224 off9312 00000040:00080000:0.0:1788528756.231740:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].7, 224 off9536 00000040:00080000:0.0:1788528756.231752:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].8, 128 off9664 00000040:00080000:0.0:1788528756.231763:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].9, 224 off9888 00000040:00080000:0.0:1788528756.231775:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].10, 224 off10112 00000040:00080000:0.0:1788528756.231786:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].11, 128 off10240 00000040:00080000:0.0:1788528756.231801:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].12, 224 off10464 00000040:00080000:0.0:1788528756.231806:0:25027:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 12 count 13 00000100:00100000:0.0:1788528756.231868:0:25027:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe690000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:25027:1875407735610368:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788528756.231919:0:25027:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528756.231968:0:25027:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c6c8f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788528756.232130:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735610368 00000100:00100000:2.0:1788528756.232137:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735610368 00000100:00100000:2.0:1788528756.232188:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788528756.232197:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5891450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+26:25027:x1875407735610368:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788528756.232305:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5891450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+26:25027:x1875407735610368:12345-0@lo:501:mount.lustre.0 Request processed in 109us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528756.232312:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788528756.232448:0:25027:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe690000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:25027:1875407735610368:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788528756.232476:0:25027:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe690000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:25027:1875407735610496:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788528756.232523:0:25027:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528756.232542:0:25027:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c6c8f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788528756.232673:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735610496 00000100:00100000:2.0:1788528756.232678:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735610496 00000100:00100000:2.0:1788528756.232700:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788528756.232706:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5892c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+26:25027:x1875407735610496:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788528756.232775:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5892c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+26:25027:x1875407735610496:12345-0@lo:503:mount.lustre.0 Request processed in 68us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528756.232782:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788528756.234609:0:25027:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe690000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:25027:1875407735610496:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788528756.235019:0:25027:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788528756.235239:0:25027:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe690000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:25027:1875407735610624:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788528756.235313:0:25027:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528756.235361:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735610624 00000100:00100000:0.0:1788528756.235367:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735610624 00000100:00100000:0.0:1788528756.235412:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788528756.235419:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c4001850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+26:25027:x1875407735610624:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788528756.235522:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c4001850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+26:25027:x1875407735610624:12345-0@lo:502:mount.lustre.0 Request processed in 103us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528756.235529:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788528756.235600:0:25027:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c6c8f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528756.235619:0:25027:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe690000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:25027:1875407735610624:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788528756.235782:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].1, 224 off8416 00000040:00080000:0.0:1788528756.235806:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].2, 112 off8528 00000040:00080000:0.0:1788528756.235818:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].3, 224 off8752 00000040:00080000:0.0:1788528756.235830:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].4, 224 off8976 00000040:00080000:0.0:1788528756.235840:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].5, 112 off9088 00000040:00080000:0.0:1788528756.235852:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].6, 224 off9312 00000040:00080000:0.0:1788528756.235863:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].7, 224 off9536 00000040:00080000:0.0:1788528756.235874:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].8, 128 off9664 00000040:00080000:0.0:1788528756.235885:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].9, 224 off9888 00000040:00080000:0.0:1788528756.235896:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].10, 224 off10112 00000040:00080000:0.0:1788528756.235908:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].11, 128 off10240 00000100:00100000:0.0:1788528756.235929:0:25027:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe690000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:25027:1875407735610752:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788528756.235973:0:25027:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528756.235997:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735610752 00000100:00100000:0.0:1788528756.236001:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735610752 00000100:00100000:0.0:1788528756.236023:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788528756.236030:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c4003450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+26:25027:x1875407735610752:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788528756.239718:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c4003450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+26:25027:x1875407735610752:12345-0@lo:502:mount.lustre.0 Request processed in 3680us (3736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528756.239730:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788528756.239799:0:25027:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c6c8f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528756.239822:0:25027:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe690000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:25027:1875407735610752:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788528756.239911:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].12, 224 off10464 00000040:00080000:0.0:1788528756.239928:0:25027:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788528756.241829:0:25035:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788528756.241842:0:25035:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528756.241844:0:25035:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788528756.241850:0:25035:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a8fc4779000 00000020:00000080:3.0:1788528756.241853:0:25035:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788528756.241860:0:25035:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788528756.241862:0:25035:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528756.241863:0:25035:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788528756.241866:0:25035:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788528756.241873:0:25035:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528756.241875:0:25035:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788528756.241879:0:25035:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a8fc4779000 00000020:00000080:3.0:1788528756.241881:0:25035:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788528756.241929:0:25035:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788528756.241932:0:25035:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528756.241934:0:25035:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788528756.241936:0:25035:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788528756.241938:0:25035:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528756.241940:0:25035:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788528756.241943:0:25035:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a8fc4779000 00000020:00000080:3.0:1788528756.241954:0:25035:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788528756.241974:0:25035:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788528756.241978:0:25035:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528756.241979:0:25035:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788528756.241982:0:25035:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788528756.241984:0:25035:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528756.241985:0:25035:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788528756.241988:0:25035:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a8fc4779000 00000020:00000080:3.0:1788528756.241990:0:25035:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788528756.242010:0:25035:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788528756.242014:0:25035:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788528756.242015:0:25035:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788528756.242018:0:25035:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 13 count 13 00000020:01000000:1.0:1788528756.242276:0:25027:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788528756.242289:0:25027:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788528756.242316:0:25027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3600/0x892c60dda91c9703 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c970a expref: -99 pid: 25027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528756.242328:0:25027:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3600/0x892c60dda91c9703 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c970a expref: -99 pid: 25027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528756.242382:0:25027:0:(mgc_request.c:2207:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788528756.242386:0:25027:0:(mgc_request.c:423:config_log_add()) add config log lustre-client-ffff8a8fc4779000 10000000:01000000:1.0:1788528756.242389:0:25027:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff8a8fc4779000 10000000:01000000:1.0:1788528756.242394:0:25027:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788528756.242410:0:25027:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.203.138@tcp: setup lustre-OST0001-osd 00000040:01000000:1.0:1788528756.242459:0:25027:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 1 is initialized 00000040:01000000:1.0:1788528756.242466:0:25027:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 10000000:01000000:1.0:1788528756.242482:0:25027:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-client-ffff8a8fc4779000 from 1 10000000:01000000:1.0:1788528756.242485:0:25027:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788528756.242532:0:25027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c784e200/0x892c60dda91c9711 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528756.242540:0:25027:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c784e200/0x892c60dda91c9711 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528756.242571:0:25027:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c784e200/0x892c60dda91c9711 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528756.242603:0:25027:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4677480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:25027:1875407735610880:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788528756.242664:0:25027:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528756.242698:0:25027:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc1c8f480 going to sleep for 11 seconds 00000100:00100000:3.0:1788528756.244271:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735610880 00000100:00100000:3.0:1788528756.244282:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735610880 00000100:00100000:3.0:1788528756.244336:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788528756.244345:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c4002450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+26:25027:x1875407735610880:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788528756.244361:0:22700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528756.244377:0:22700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c6c83600/0x892c60dda91c9718 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c9711 expref: -99 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528756.244413:0:22700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c6c83600/0x892c60dda91c9718 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c9711 expref: 27 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528756.244423:0:22700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c6c83600/0x892c60dda91c9718 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c9711 expref: 27 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528756.244432:0:22700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c6c83600, rc 0) 00000100:00100000:3.0:1788528756.244490:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c4002450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+27:25027:x1875407735610880:12345-0@lo:101:mount.lustre.0 Request processed in 146us (1826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528756.244496:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788528756.244671:0:25027:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4677480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:25027:1875407735610880:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788528756.244688:0:25027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c784e200/0x892c60dda91c9711 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9718 expref: -99 pid: 25027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528756.244698:0:25027:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c784e200/0x892c60dda91c9711 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c9718 expref: -99 pid: 25027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788528756.258779:0:25027:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 52 count 51 00000040:00080000:2.0:1788528756.259273:0:25027:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788528756.259471:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].1, 224 off8416 00000040:00080000:2.0:1788528756.259496:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].2, 120 off8536 00000040:00080000:2.0:1788528756.259508:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].3, 168 off8704 00000040:00080000:2.0:1788528756.260367:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].4, 224 off8928 00000040:00080000:2.0:1788528756.260402:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].5, 224 off9152 00000040:00080000:2.0:1788528756.260418:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].6, 120 off9272 00000040:00080000:2.0:1788528756.260432:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].7, 168 off9440 00000040:00080000:2.0:1788528756.260445:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].8, 224 off9664 00000040:00080000:2.0:1788528756.260457:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].9, 224 off9888 00000040:00080000:2.0:1788528756.260471:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].10, 120 off10008 00000040:00080000:2.0:1788528756.260484:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].11, 224 off10232 00000040:00080000:2.0:1788528756.260498:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].12, 224 off10456 00000040:00080000:2.0:1788528756.261353:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].13, 88 off10544 00000040:00080000:2.0:1788528756.261386:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].14, 128 off10672 00000040:00080000:2.0:1788528756.261399:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].15, 144 off10816 00000040:00080000:2.0:1788528756.261411:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].16, 160 off10976 00000040:00080000:2.0:1788528756.261423:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].17, 224 off11200 00000040:00080000:2.0:1788528756.261444:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].18, 224 off11424 00000040:00080000:2.0:1788528756.261455:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].19, 80 off11504 00000040:00080000:2.0:1788528756.261467:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].20, 224 off11728 00000040:00080000:2.0:1788528756.261490:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].21, 224 off11952 00000040:00080000:2.0:1788528756.261503:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].22, 88 off12040 00000040:00080000:2.0:1788528756.261527:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].23, 128 off12168 00000040:00080000:2.0:1788528756.261541:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].24, 144 off12312 00000040:00080000:2.0:1788528756.261575:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].25, 160 off12472 00000040:00080000:2.0:1788528756.261590:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].26, 224 off12696 00000040:00080000:2.0:1788528756.261601:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].27, 224 off12920 00000040:00080000:2.0:1788528756.261612:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].28, 80 off13000 00000040:00080000:2.0:1788528756.261623:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].29, 224 off13224 00000040:00080000:2.0:1788528756.261634:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].30, 224 off13448 00000040:00080000:2.0:1788528756.261646:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].31, 88 off13536 00000040:00080000:2.0:1788528756.261657:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].32, 128 off13664 00000040:00080000:2.0:1788528756.261669:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].33, 144 off13808 00000040:00080000:2.0:1788528756.261683:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].34, 128 off13936 00000040:00080000:2.0:1788528756.261695:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].35, 224 off14160 00000040:00080000:2.0:1788528756.261706:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].36, 224 off14384 00000040:00080000:2.0:1788528756.261730:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].37, 80 off14464 00000040:00080000:2.0:1788528756.261745:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].38, 224 off14688 00000040:00080000:2.0:1788528756.261756:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].39, 224 off14912 00000040:00080000:2.0:1788528756.261768:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].40, 88 off15000 00000040:00080000:2.0:1788528756.261780:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].41, 128 off15128 00000040:00080000:2.0:1788528756.261791:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].42, 144 off15272 00000040:00080000:2.0:1788528756.261803:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].43, 128 off15400 00000040:00080000:2.0:1788528756.261815:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].44, 224 off15624 00000040:00080000:2.0:1788528756.261829:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].45, 224 off15848 00000040:00080000:2.0:1788528756.261840:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].46, 80 off15928 00000040:00080000:2.0:1788528756.261851:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].47, 224 off16152 00000040:00080000:2.0:1788528756.261863:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].48, 232 off16384 00000040:00080000:2.0:1788528756.262019:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].49, 224 off16608 00000040:00080000:2.0:1788528756.262039:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].50, 120 off16728 00000040:00080000:2.0:1788528756.262064:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].51, 224 off16952 00000040:00080000:2.0:1788528756.264249:0:25027:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 51 count 51 00000100:00100000:2.0:1788528756.264364:0:25027:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6bc9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:25027:1875407735611008:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788528756.264426:0:25027:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528756.264469:0:25027:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d162ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788528756.266247:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735611008 00000100:00100000:1.0:1788528756.266261:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735611008 00000100:00100000:1.0:1788528756.266320:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788528756.266329:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c4002850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+27:25027:x1875407735611008:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788528756.266488:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c4002850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+27:25027:x1875407735611008:12345-0@lo:501:mount.lustre.0 Request processed in 160us (2062us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528756.266496:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788528756.266682:0:25027:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6bc9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:25027:1875407735611008:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788528756.266724:0:25027:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6bc9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:25027:1875407735611136:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788528756.266773:0:25027:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528756.266801:0:25027:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d162ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788528756.267230:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735611136 00000100:00100000:1.0:1788528756.267236:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735611136 00000100:00100000:1.0:1788528756.267272:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788528756.267279:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c4000050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+27:25027:x1875407735611136:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788528756.267369:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c4000050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+27:25027:x1875407735611136:12345-0@lo:503:mount.lustre.0 Request processed in 89us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528756.267376:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788528756.267632:0:25027:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6bc9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:25027:1875407735611136:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788528756.268035:0:25027:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788528756.272797:0:25027:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6bc9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:25027:1875407735611264:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788528756.272874:0:25027:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528756.272916:0:25027:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c8d93f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788528756.273021:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735611264 00000100:00100000:1.0:1788528756.273034:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735611264 00000100:00100000:1.0:1788528756.273107:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788528756.273115:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c4003c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+27:25027:x1875407735611264:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788528756.273379:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c4003c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+27:25027:x1875407735611264:12345-0@lo:502:mount.lustre.0 Request processed in 264us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528756.273387:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788528756.273767:0:25027:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6bc9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:25027:1875407735611264:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788528756.273987:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].1, 224 off8416 00000040:00080000:2.0:1788528756.274017:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].2, 120 off8536 00000040:00080000:2.0:1788528756.274030:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].3, 168 off8704 00000040:00080000:2.0:1788528756.274043:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].4, 224 off8928 00000040:00080000:2.0:1788528756.274053:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].5, 224 off9152 00000040:00080000:2.0:1788528756.274064:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].6, 120 off9272 00000040:00080000:2.0:1788528756.274092:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].7, 168 off9440 00000040:00080000:2.0:1788528756.274120:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].8, 224 off9664 00000040:00080000:2.0:1788528756.274134:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].9, 224 off9888 00000040:00080000:2.0:1788528756.274159:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].10, 120 off10008 00000040:00080000:2.0:1788528756.274174:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].11, 224 off10232 00000040:00080000:2.0:1788528756.274188:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].12, 224 off10456 00000040:00080000:2.0:1788528756.274212:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].13, 88 off10544 00000040:00080000:2.0:1788528756.274227:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].14, 128 off10672 00000040:00080000:2.0:1788528756.274239:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].15, 144 off10816 00000040:00080000:2.0:1788528756.274252:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].16, 160 off10976 00000040:00080000:2.0:1788528756.274264:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].17, 224 off11200 00000040:00080000:2.0:1788528756.274274:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].18, 224 off11424 00000040:00080000:2.0:1788528756.274285:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].19, 80 off11504 00000040:00080000:2.0:1788528756.274296:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].20, 224 off11728 00000040:00080000:2.0:1788528756.274308:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].21, 224 off11952 00000040:00080000:2.0:1788528756.274319:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].22, 88 off12040 00000040:00080000:2.0:1788528756.274329:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].23, 128 off12168 00000040:00080000:2.0:1788528756.274352:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].24, 144 off12312 00000040:00080000:2.0:1788528756.274364:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].25, 160 off12472 00000040:00080000:2.0:1788528756.274376:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].26, 224 off12696 00000040:00080000:2.0:1788528756.274386:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].27, 224 off12920 00000040:00080000:2.0:1788528756.274397:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].28, 80 off13000 00000040:00080000:2.0:1788528756.274408:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].29, 224 off13224 00000040:00080000:2.0:1788528756.274419:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].30, 224 off13448 00000040:00080000:2.0:1788528756.274431:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].31, 88 off13536 00000040:00080000:2.0:1788528756.274442:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].32, 128 off13664 00000040:00080000:2.0:1788528756.274453:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].33, 144 off13808 00000040:00080000:2.0:1788528756.274464:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].34, 128 off13936 00000040:00080000:2.0:1788528756.274475:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].35, 224 off14160 00000040:00080000:2.0:1788528756.274487:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].36, 224 off14384 00000040:00080000:2.0:1788528756.274498:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].37, 80 off14464 00000040:00080000:2.0:1788528756.274520:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].38, 224 off14688 00000040:00080000:2.0:1788528756.274535:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].39, 224 off14912 00000040:00080000:2.0:1788528756.274787:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].40, 88 off15000 00000040:00080000:2.0:1788528756.274806:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].41, 128 off15128 00000040:00080000:2.0:1788528756.274819:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].42, 144 off15272 00000040:00080000:2.0:1788528756.274833:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].43, 128 off15400 00000040:00080000:2.0:1788528756.274844:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].44, 224 off15624 00000040:00080000:2.0:1788528756.274855:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].45, 224 off15848 00000040:00080000:2.0:1788528756.274879:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].46, 80 off15928 00000040:00080000:2.0:1788528756.274892:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].47, 224 off16152 00000040:00080000:2.0:1788528756.274904:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].48, 232 off16384 00000100:00100000:2.0:1788528756.274958:0:25027:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6bc9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:25027:1875407735611392:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788528756.275020:0:25027:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528756.275113:0:25027:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c8d93f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788528756.278268:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735611392 00000100:00100000:3.0:1788528756.278281:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735611392 00000100:00100000:0.0:1788528756.281903:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788528756.281917:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c4001050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+27:25027:x1875407735611392:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788528756.282348:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c4001050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+27:25027:x1875407735611392:12345-0@lo:502:mount.lustre.0 Request processed in 433us (7326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528756.282356:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788528756.282475:0:25027:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6bc9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:25027:1875407735611392:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788528756.282771:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].49, 224 off16608 00000040:00080000:3.0:1788528756.282799:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].50, 120 off16728 00000100:00100000:3.0:1788528756.282834:0:25027:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:25027:1875407735611520:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788528756.282881:0:25027:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528756.282916:0:25027:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc2695600 going to sleep for 11 seconds 00000100:00100000:0.0:1788528756.283058:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735611520 00000100:00100000:0.0:1788528756.283064:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735611520 00000100:00100000:0.0:1788528756.283104:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788528756.283111:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c4000450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+27:25027:x1875407735611520:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788528756.283374:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c4000450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+27:25027:x1875407735611520:12345-0@lo:502:mount.lustre.0 Request processed in 263us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528756.283381:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788528756.283459:0:25027:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:25027:1875407735611520:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788528756.283501:0:25027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].51, 224 off16952 00000040:00080000:3.0:1788528756.283522:0:25027:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788528756.284419:0:25040:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788528756.284433:0:25040:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8a90fa60cc80) 00000020:00000080:3.0:1788528756.284453:0:25040:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1788528756.284544:0:25040:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8a8fc4779000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788528756.284548:0:25040:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8a8fc4779000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788528756.284581:0:25040:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8a8fc4779000 3 00010000:00080000:3.0:1788528756.284609:0:25040:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a9101c95800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.138@tcp at head 00010000:00010000:3.0:1788528756.290788:0:25040:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1788528756.291009:0:25040:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788528756.291056:0:25040:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788528756.291069:0:25040:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x892c60dda91c9726 00000100:00080000:3.0:1788528756.291079:0:25040:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788528756.291084:0:25040:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a9101c95800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1788528756.291119:0:25040:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90fa8ad180 x1875407735611648/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788528756.291310:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1875407735611648:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788528756.291377:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788528756.291437:0:25040:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788528756.291481:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788528756.291485:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788528756.291488:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788528756.291490:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788528756.291515:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788528756.291518:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788528756.291521:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1d14800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788528756.291525:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 621 00000100:00080000:3.0:1788528756.291529:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788528756.291532:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a8fc1d14800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1788528756.291543:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90fa8afb80 x1875407735612288/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788528756.291855:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735612288:0@lo:8:kworker.0 00000100:00100000:2.0:1788528756.291886:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528756.291970:0:24212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735612288 00000100:00100000:1.0:1788528756.291977:0:24212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735612288 00000100:00100000:1.0:1788528756.292019:0:24212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788528756.292026:0:24212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6bca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1875407735612288:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788528756.292094:0:24212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6bca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1875407735612288:12345-0@lo:8:kworker.0 Request processed in 67us (207us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788528756.292102:0:24212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788528756.292283:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788528756.292290:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1d14800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788528756.292294:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788528756.292298:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735612288:0@lo:8:kworker.0 00000100:00100000:0.0:1788528756.292373:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735611648 00000100:00100000:0.0:1788528756.292378:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735611648 00000100:00100000:0.0:1788528756.292404:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788528756.292409:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1875407735611648:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788528756.292426:0:22705:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 625 last 0 00000020:00000080:0.0:1788528756.292459:0:22705:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x892c60dda91c972d 00000004:00100000:0.0:1788528756.292472:0:22705:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788528756.292501:0:22705:0:(import.c:65:import_set_state_nolock()) ffff8a8fc253f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788528756.292578:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875407735611648:12345-0@lo:38:llog_process_th.0 Request processed in 168us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528756.292585:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788528756.293376:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90fa8ad180 x1875407735611648/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788528766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528756.293388:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788528756.293394:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1788528756.293400:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788528756.293404:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788528756.293407:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a9101c95800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788528756.293413:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1875407735611648:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788528756.293616:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735612160:0@lo:400:kworker.0 00000100:00100000:2.0:1788528756.293659:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528756.293693:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788528756.293711:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735611776:0@lo:400:kworker.0 00000100:00100000:2.0:1788528756.293739:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528756.293772:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735611776 00000100:00100000:2.0:1788528756.293777:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735611776 00000100:00100000:2.0:1788528756.293815:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788528756.293823:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6bc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735611776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528756.293868:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6bc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735611776:12345-0@lo:400:kworker.0 Request processed in 46us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528756.293875:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788528756.293905:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735611776:0@lo:400:kworker.0 00000100:00100000:3.0:1788528756.296337:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875407735611904:0@lo:400:kworker.0 00000100:00100000:3.0:1788528756.296394:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528756.296428:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1875407735612544:0@lo:400:kworker.0 00000100:00100000:3.0:1788528756.296462:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528756.296495:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788528756.296500:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735612032:0@lo:400:kworker.0 00000100:00100000:3.0:1788528756.296531:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528756.296548:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1875407735612672:0@lo:400:kworker.0 00000100:00100000:3.0:1788528756.296588:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528756.296620:0:24214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735612160 00000100:00100000:3.0:1788528756.296628:0:24214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735612160 00000100:00100000:3.0:1788528756.296683:0:24214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788528756.296691:0:24214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6bc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735612160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528756.296734:0:24214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6bc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735612160:12345-0@lo:400:kworker.0 Request processed in 44us (3074us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528756.296741:0:24214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788528756.296763:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875407735612416:0@lo:400:kworker.0 00000100:00100000:3.0:1788528756.296787:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528756.296808:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735611904 00000100:00100000:3.0:1788528756.296811:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735611904 00000100:00100000:3.0:1788528756.296831:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735612544 00000100:00100000:3.0:1788528756.296833:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735612544 00000100:00100000:3.0:1788528756.296846:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735612672 00000100:00100000:3.0:1788528756.296849:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735612672 00000100:00100000:3.0:1788528756.296873:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735612416 00000100:00100000:3.0:1788528756.296876:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735612416 00000100:00100000:1.0:1788528756.296957:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788528756.296966:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875407735611904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528756.297004:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875407735611904:12345-0@lo:400:kworker.0 Request processed in 40us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528756.297012:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788528756.297026:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788528756.297033:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875407735612544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528756.297057:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875407735612544:12345-0@lo:400:kworker.0 Request processed in 25us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528756.297063:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788528756.297087:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788528756.297094:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875407735612672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528756.297118:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875407735612672:12345-0@lo:400:kworker.0 Request processed in 25us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528756.297130:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788528756.297151:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788528756.297156:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875407735612416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528756.297186:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875407735612416:12345-0@lo:400:kworker.0 Request processed in 30us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528756.297192:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788528756.297590:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735612032 00000100:00100000:3.0:1788528756.297595:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735612032 00000100:00100000:3.0:1788528756.297624:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788528756.297631:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735612032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528756.297670:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735612032:12345-0@lo:400:kworker.0 Request processed in 40us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528756.297677:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1788528756.297695:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788528756.297699:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788528756.297701:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788528756.297732:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735612032:0@lo:400:kworker.0 00010000:00080000:3.0:1788528756.297745:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90fa8afb80 x1875407735612672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528756.297755:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1875407735612672:0@lo:400:kworker.0 00010000:00080000:3.0:1788528756.297765:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90fa8ac700 x1875407735611904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528756.297772:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875407735611904:0@lo:400:kworker.0 00010000:00080000:3.0:1788528756.297781:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90fa8ad180 x1875407735612544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528756.297787:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1875407735612544:0@lo:400:kworker.0 00010000:00080000:3.0:1788528756.297819:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90fa8ace00 x1875407735612416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528756.297827:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875407735612416:0@lo:400:kworker.0 00010000:00080000:3.0:1788528756.297850:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90fa8ac380 x1875407735612160/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528756.297858:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735612160:0@lo:400:kworker.0 00000020:01000004:3.0:1788528756.297983:0:25040:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788528756.298004:0:25040:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8a90fa608000) 00000020:00000080:3.0:1788528756.298025:0:25040:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1788528756.299274:0:25040:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8a8fc4779000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788528756.299282:0:25040:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8a8fc4779000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788528756.299285:0:25040:0:(obd_mount.c:712:lustre_put_lsi()) put ffff8a8fc4779000 3 00010000:00080000:3.0:1788528756.299321:0:25040:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a8fc4fa1800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.138@tcp at head 00010000:00010000:3.0:1788528756.302734:0:25040:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1788528756.302919:0:25040:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1788528756.302979:0:25040:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788528756.302995:0:25040:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x892c60dda91c973b 00000100:00080000:3.0:1788528756.303004:0:25040:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788528756.303009:0:25040:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8a8fc4fa1800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1788528756.303044:0:25040:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a90ffa4e680 x1875407735612800/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788528756.303256:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1875407735612800:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788528756.303322:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528756.303380:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735612800 00000100:00100000:2.0:1788528756.303387:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735612800 00000100:00100000:2.0:1788528756.303423:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788528756.303430:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6bc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1875407735612800:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788528756.303453:0:22705:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 625 last 0 00000020:00000080:2.0:1788528756.303495:0:22705:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x892c60dda91c9742 00000004:00100000:2.0:1788528756.303508:0:22705:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788528756.303625:0:22705:0:(import.c:65:import_set_state_nolock()) ffff8a8fc47e4000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788528756.303676:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6bc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875407735612800:12345-0@lo:38:llog_process_th.0 Request processed in 245us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528756.303684:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788528756.303719:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a90ffa4e680 x1875407735612800/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788528766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528756.303729:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788528756.303743:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1788528756.303750:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788528756.303754:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788528756.303756:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc4fa1800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788528756.303762:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1875407735612800:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788528756.304244:0:25040:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788528756.304280:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788528756.304286:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788528756.304288:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788528756.304291:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1788528756.306321:0:25040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 52 count 51 00000020:01000000:2.0:1788528756.306545:0:25027:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788528756.306581:0:25027:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788528756.306601:0:25027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c784e200/0x892c60dda91c9711 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9718 expref: -99 pid: 25027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528756.306613:0:25027:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c784e200/0x892c60dda91c9711 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9718 expref: -99 pid: 25027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788528756.306671:0:25027:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788528756.306673:0:25027:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788528756.306675:0:25027:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788528756.306676:0:25027:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788528756.306677:0:25027:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788528756.306679:0:25027:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788528756.306681:0:25027:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788528756.306683:0:25027:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788528756.306684:0:25027:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788528756.306688:0:25027:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788528756.306690:0:25027:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788528756.306692:0:25027:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788528756.306693:0:25027:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788528756.306694:0:25027:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788528756.306695:0:25027:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788528756.306696:0:25027:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788528756.306697:0:25027:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788528756.306698:0:25027:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788528756.306699:0:25027:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788528756.306725:0:25027:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788528756.306743:0:25027:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6bc9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:25027:1875407735612928:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788528756.306818:0:25027:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528756.306853:0:25027:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c8d93f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788528756.307747:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735612928 00000100:00100000:0.0:1788528756.307757:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735612928 00000100:00100000:0.0:1788528756.307848:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788528756.307858:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c4002050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+27:25027:x1875407735612928:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788528756.307889:0:22698:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788528756.307910:0:22698:0:(mgs_nids.c:468:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788528756.321364:0:22698:0:(mgs_nids.c:820:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788528756.321389:0:22698:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788528756.321788:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c4002050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+27:25027:x1875407735612928:12345-0@lo:253:mount.lustre.0 Request processed in 13927us (14964us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528756.321800:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788528756.321867:0:25027:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6bc9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07f6b94a-1259-41bf-8282-a67e1c8aef03:25027:1875407735612928:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788528756.321881:0:25027:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788528756.321884:0:25027:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788528756.321886:0:25027:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788528756.321888:0:25027:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788528756.321889:0:25027:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788528756.321890:0:25027:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788528756.321891:0:25027:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788528756.321893:0:25027:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788528756.321894:0:25027:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788528756.321896:0:25027:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788528756.321910:0:25027:0:(tgt_mount.c:2815:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1788528756.323454:0:22721:0:(mgs_nids.c:717:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788528756.323460:0:22721:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788528756.323481:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a90c6c82800/0x892c60dda91c9749 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528756.323497:0:22721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9101851200/0x892c60dda91c96af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c96a8 expref: 26 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528756.323526:0:22721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a8fc26e3400/0x892c60dda91c96bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c96b6 expref: 26 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528756.323538:0:22721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a90c6c82800/0x892c60dda91c9749 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528756.323596:0:22721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a8fc26e3400/0x892c60dda91c96bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c96b6 expref: 26 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528756.323611:0:22721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a8fc26e3400/0x892c60dda91c96bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c96b6 expref: 26 pid: 22698 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528756.323628:0:22721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22721:1875407735613056:0@lo:104: 00000100:00100000:3.0:1788528756.323678:0:22721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788528756.323719:0:22721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9101851200/0x892c60dda91c96af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c96a8 expref: 26 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528756.323727:0:22721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a9101851200/0x892c60dda91c96af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c96a8 expref: 26 pid: 22698 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528756.323735:0:22721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22721:1875407735613184:0@lo:104: 00000100:00100000:3.0:1788528756.323752:0:22721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528756.323765:0:22721:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c3902900 going to sleep for 11 seconds 00000100:00100000:3.0:1788528756.323783:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735613056 00000100:00100000:3.0:1788528756.323789:0:22688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735613056 00000100:00100000:3.0:1788528756.323920:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735613184 00000100:00100000:3.0:1788528756.323924:0:22688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735613184 00000100:00100000:3.0:1788528756.323941:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788528756.323959:0:22688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07f6b94a-1259-41bf-8282-a67e1c8aef03+4:22721:x1875407735613056:12345-0@lo:104: 00010000:00010000:3.0:1788528756.323977:0:22688:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3c00/0x892c60dda91c96b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c96bd expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528756.324035:0:22688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788528756.324041:0:22688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07f6b94a-1259-41bf-8282-a67e1c8aef03+4:22721:x1875407735613056:12345-0@lo:104: Request processed in 93us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528756.324048:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788528756.324064:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788528756.324080:0:22688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07f6b94a-1259-41bf-8282-a67e1c8aef03+3:22721:x1875407735613184:12345-0@lo:104: 00010000:00010000:3.0:1788528756.324088:0:22688:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2400/0x892c60dda91c96a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c96af expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528756.324117:0:22688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788528756.324122:0:22688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07f6b94a-1259-41bf-8282-a67e1c8aef03+3:22721:x1875407735613184:12345-0@lo:104: Request processed in 53us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528756.324127:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788528756.324391:0:22721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22721:1875407735613056:0@lo:104: 00000100:00100000:1.0:1788528756.324404:0:22721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22721:1875407735613184:0@lo:104: 00010000:00010000:1.0:1788528756.324428:0:22721:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a90c6c82800/0x892c60dda91c9749 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528756.325302:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788528756.325310:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3c00/0x892c60dda91c96b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c96bd expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528756.325319:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc26e3c00 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:3.0:1788528756.325324:0:22693:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3c00/0x892c60dda91c96b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c96bd expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528756.325335:0:22693:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3c00/0x892c60dda91c96b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c96bd expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788528756.325343:0:22693:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3c00/0x892c60dda91c96b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c96bd expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528756.325359:0:22693:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788528756.325392:0:22693:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3c00/0x892c60dda91c96b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c96bd expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528756.325399:0:22693:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788528756.325418:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3c00/0x892c60dda91c96b6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c96bd expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528756.325424:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3c00/0x892c60dda91c96b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c96bd expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528756.325436:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788528756.325439:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2400/0x892c60dda91c96a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c96af expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528756.325444:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc26e2400 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:3.0:1788528756.325447:0:22693:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2400/0x892c60dda91c96a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c96af expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528756.325453:0:22693:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2400/0x892c60dda91c96a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c96af expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788528756.325460:0:22693:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2400/0x892c60dda91c96a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c96af expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788528756.325465:0:22693:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788528756.325477:0:22693:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2400/0x892c60dda91c96a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c96af expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528756.325484:0:22693:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788528756.325496:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2400/0x892c60dda91c96a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c96af expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528756.325503:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2400/0x892c60dda91c96a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c96af expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528756.325645:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528756.325648:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528756.325650:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528756.325657:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528756.325672:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07f6b94a-1259-41bf-8282-a67e1c8aef03:3637:1875407735613312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788528756.325718:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528756.325754:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788528756.325760:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07f6b94a-1259-41bf-8282-a67e1c8aef03:3637:1875407735613440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788528756.325779:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528756.325809:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735613312 00000100:00100000:3.0:1788528756.325814:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735613312 00010000:00010000:3.0:1788528756.325836:0:22692:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a8fc26e3400/0x892c60dda91c96bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c96b6 expref: 27 pid: 22698 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528756.325858:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735613440 00000100:00100000:3.0:1788528756.325861:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735613440 00010000:00010000:3.0:1788528756.325872:0:22692:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9101851200/0x892c60dda91c96af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c96a8 expref: 28 pid: 22698 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528756.325889:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788528756.325896:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07f6b94a-1259-41bf-8282-a67e1c8aef03+28:3637:x1875407735613312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788528756.325908:0:22692:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528756.325913:0:22692:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a8fc26e3400/0x892c60dda91c96bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c96b6 expref: 28 pid: 22698 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528756.325935:0:22692:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a8fc26e3400/0x892c60dda91c96bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c96b6 expref: 28 pid: 22698 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528756.325961:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a8fc26e3400/0x892c60dda91c96bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c96b6 expref: 28 pid: 22698 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528756.325974:0:22692:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788528756.326005:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07f6b94a-1259-41bf-8282-a67e1c8aef03+27:3637:x1875407735613312:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528756.326012:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788528756.326027:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788528756.326033:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07f6b94a-1259-41bf-8282-a67e1c8aef03+26:3637:x1875407735613440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788528756.326040:0:22692:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528756.326044:0:22692:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9101851200/0x892c60dda91c96af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c96a8 expref: 26 pid: 22698 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528756.326053:0:22692:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9101851200/0x892c60dda91c96af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c96a8 expref: 26 pid: 22698 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528756.326064:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9101851200/0x892c60dda91c96af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c96a8 expref: 26 pid: 22698 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528756.326087:0:22692:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a90c6c82800/0x892c60dda91c9749 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528756.326096:0:22692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c6c82800/0x892c60dda91c9749 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788528756.326109:0:22692:0:(mgs_nids.c:693:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014698143s 00010000:00010000:3.0:1788528756.326119:0:22692:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a90c6c82800/0x892c60dda91c9749 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528756.326128:0:22692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a90c6c82800/0x892c60dda91c9749 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528756.326135:0:22692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a90c6c82800/0x892c60dda91c9749 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528756.326143:0:22692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a90c6c82800/0x892c60dda91c9749 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528756.326148:0:22692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c6c82800 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528756.326153:0:22692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a90c6c82800/0x892c60dda91c9749 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528756.326161:0:22692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a90c6c82800/0x892c60dda91c9749 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528756.328025:0:22692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a90c6c82800/0x892c60dda91c9749 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528756.328039:0:22692:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788528756.328492:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07f6b94a-1259-41bf-8282-a67e1c8aef03+25:3637:x1875407735613440:12345-0@lo:103:ldlm_bl.0 Request processed in 2455us (2707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528756.328502:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788528756.328647:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07f6b94a-1259-41bf-8282-a67e1c8aef03:3637:1875407735613440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788528756.328658:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07f6b94a-1259-41bf-8282-a67e1c8aef03:3637:1875407735613312:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788528756.328825:0:22721:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a90c6c82800/0x892c60dda91c9749 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528756.328835:0:22721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a90c6c82800/0x892c60dda91c9749 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528756.328844:0:22721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c6c82800/0x892c60dda91c9749 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1788528756.330096:0:25027:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1788528756.333745:0:25027:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788528756.333756:0:25027:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788528756.333884:0:25027:0:(tgt_mount.c:2543:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1788528756.333908:0:25027:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1788528756.334819:0:25027:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788528756.335082:0:25027:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788528756.928412:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788528757.217283:0:25093:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788528757.217748:0:25093:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788528757.311007:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788528737/real 1788528737] req@ffff8a90fe693480 x1875407735600000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788528757 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528757.311036:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a90fe693480 x1875407735600000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788528757 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528757.311045:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788528737/real 1788528737] req@ffff8a90fe692a00 x1875407735600128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788528757 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528757.311055:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a90fe692a00 x1875407735600128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788528757 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788528757.311083:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3d1e000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788528757.311107:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788528757.311111:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735600000:0@lo:8:kworker.0 00000100:00080000:0.0:1788528757.311117:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1d13000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788528757.311123:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788528757.311126:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe692a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735600128:0@lo:8:kworker.0 00000100:00080000:1.0:1788528757.311247:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788528757.311251:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788528757.311254:0:469:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3d1e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788528757.311259:0:469:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 607 00000100:00080000:1.0:1788528757.311264:0:469:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788528757.311270:0:469:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a8fc3d1e000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1788528757.311288:0:469:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a8fc4676300 x1875407735613824/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788528757.311303:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788528757.311311:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788528757.311313:0:469:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1d13000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788528757.311316:0:469:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 607 00000100:00080000:1.0:1788528757.311319:0:469:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788528757.311322:0:469:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a8fc1d13000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1788528757.311334:0:469:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a8fc4675c00 x1875407735613952/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788528757.311379:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788528757.311382:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788528757.311384:0:469:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1d14800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788528757.311388:0:469:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a8fc1d14800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1788528757.311398:0:469:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a8fc37aed80 x1875407735614464/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788528757.311446:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4676300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735613824:0@lo:8:kworker.0 00000100:00100000:1.0:1788528757.311506:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528757.311541:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4675c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735613952:0@lo:8:kworker.0 00000100:00100000:1.0:1788528757.311585:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528757.311603:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735614464:0@lo:8:kworker.0 00000100:00100000:1.0:1788528757.311627:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528757.311653:0:24212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735613824 00000100:00100000:1.0:1788528757.311661:0:24212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735613824 00000100:00100000:1.0:1788528757.311684:0:24212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735613952 00000100:00100000:1.0:1788528757.311687:0:24212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735613952 00000100:00100000:1.0:1788528757.311695:0:24212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735614464 00000100:00100000:1.0:1788528757.311697:0:24212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735614464 00000100:00100000:1.0:1788528757.311708:0:24212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788528757.311722:0:24212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1875407735613824:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788528757.311749:0:24212:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 626 last 0 00000020:00000080:1.0:1788528757.311776:0:24212:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x892c60dda91c9750 00002000:00100000:1.0:1788528757.311789:0:24212:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8a90fddb3000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788528757.311793:0:24212:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788528757.311796:0:24212:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788528757.311868:0:24212:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788528757.311892:0:24212:0:(import.c:65:import_set_state_nolock()) ffff8a90fddb6000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788528757.311949:0:24212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1875407735613824:12345-0@lo:8:kworker.0 Request processed in 216us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528757.311956:0:24212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788528757.311972:0:24212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788528757.311977:0:24212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1875407735613952:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788528757.311991:0:24212:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 626 last 0 00000020:00000080:1.0:1788528757.312018:0:24212:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x892c60dda91c9757 00002000:00100000:1.0:1788528757.312024:0:24212:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8a90f69c5000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788528757.312028:0:24212:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788528757.312031:0:24212:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788528757.312170:0:24212:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788528757.312184:0:24212:0:(import.c:65:import_set_state_nolock()) ffff8a90f69c1000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788528757.312214:0:24212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1875407735613952:12345-0@lo:8:kworker.0 Request processed in 235us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528757.312221:0:24212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788528757.312234:0:24212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788528757.312238:0:24212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1875407735614464:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788528757.312259:0:24212:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 626 last 0 00000020:00000080:1.0:1788528757.312274:0:24212:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x892c60dda91c975e 00002000:00100000:1.0:1788528757.312280:0:24212:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8a90f69c1800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1788528757.312283:0:24212:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1788528757.312284:0:24212:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788528757.312305:0:24212:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1788528757.312316:0:24212:0:(import.c:65:import_set_state_nolock()) ffff8a90f69c7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788528757.312344:0:24212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3636:x1875407735614464:12345-0@lo:8:kworker.0 Request processed in 105us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528757.312351:0:24212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788528757.312407:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc4676300 x1875407735613824/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788528782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528757.312417:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788528757.312424:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788528757.312431:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788528757.312436:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788528757.312438:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc3d1e000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788528757.312457:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788528757.312463:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4676300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735613824:0@lo:8:kworker.0 00010000:00080000:1.0:1788528757.312475:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc4675c00 x1875407735613952/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788528782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528757.312481:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788528757.312484:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788528757.312488:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788528757.312490:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788528757.312499:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1d13000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788528757.312507:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788528757.312511:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4675c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1875407735613952:0@lo:8:kworker.0 00010000:00080000:1.0:1788528757.312524:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc37aed80 x1875407735614464/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788528782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788528757.312532:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1788528757.312536:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788528757.312539:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788528757.312541:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8a8fc1d14800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788528757.312549:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788528757.312570:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1875407735614464:0@lo:8:kworker.0 00000100:00100000:3.0:1788528757.312951:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4677480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07f6b94a-1259-41bf-8282-a67e1c8aef03:3639:1875407735613568:0@lo:400:kworker.0 00000100:00100000:3.0:1788528757.313009:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528757.313038:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735614336:0@lo:400:kworker.0 00000100:00100000:3.0:1788528757.313110:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528757.313132:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1875407735614976:0@lo:400:kworker.0 00000100:00100000:3.0:1788528757.313160:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528757.313181:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788528757.313187:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735613696:0@lo:400:kworker.0 00000100:00100000:3.0:1788528757.313209:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528757.313226:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875407735614592:0@lo:400:kworker.0 00000100:00100000:3.0:1788528757.313244:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528757.313260:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1875407735615104:0@lo:400:kworker.0 00000100:00100000:3.0:1788528757.313282:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528757.313308:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4674e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875407735614080:0@lo:400:kworker.0 00000100:00100000:3.0:1788528757.313330:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528757.313342:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1875407735614720:0@lo:400:kworker.0 00000100:00100000:1.0:1788528757.313481:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735613568 00000100:00100000:1.0:1788528757.313486:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735613568 00000100:00100000:1.0:1788528757.313523:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788528757.313530:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c4003050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+25:3639:x1875407735613568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528757.313589:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c4003050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+25:3639:x1875407735613568:12345-0@lo:400:kworker.0 Request processed in 59us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528757.313595:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000004:00080000:2.0:1788528757.313607:0:22729:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788528757.313717:0:22732:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:0.0:1788528757.313735:0:22732:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe693480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22732:1875407735615360:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788528757.313755:0:22729:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 626531200400ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788528757.313761:0:22732:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:00080000:2.0:1788528757.313762:0:22729:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1788528757.313777:0:22732:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c980bcc0 going to sleep for 11 seconds 00000004:00080000:0.0:1788528757.313787:0:23450:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788528757.313832:0:23450:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 626531277951ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788528757.313837:0:23450:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788528757.314190:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528757.314213:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe692a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735615232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788528757.314240:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528757.314259:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788528757.314265:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4675500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735614208:0@lo:400:kworker.0 00000100:00100000:3.0:1788528757.314284:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528757.314298:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1875407735614848:0@lo:400:kworker.0 00000100:00100000:3.0:1788528757.314314:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528757.314337:0:24214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735614336 00000100:00100000:3.0:1788528757.314347:0:24214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735614336 00000100:00100000:1.0:1788528757.314651:0:24213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735615360 00000100:00100000:1.0:1788528757.314656:0:24213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735615360 00000100:00100000:1.0:1788528757.314692:0:24213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788528757.314699:0:24213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe690000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22732:x1875407735615360:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788528757.315026:0:24214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788528757.315034:0:24214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735614336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528757.315135:0:24214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735614336:12345-0@lo:400:kworker.0 Request processed in 101us (2076us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528757.315143:0:24214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000004:00080000:3.0:1788528757.315195:0:22730:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:3.0:1788528757.315210:0:22730:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22730:1875407735615616:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788528757.315240:0:22730:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528757.315255:0:22730:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c3902540 going to sleep for 11 seconds 00000004:00080000:3.0:1788528757.315269:0:22731:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788528757.315324:0:22731:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 626532770116ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788528757.315330:0:22731:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1788528757.315361:0:23451:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788528757.315374:0:23451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ace00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23451:1875407735615872:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1788528757.315399:0:23451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528757.315412:0:23451:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c3902480 going to sleep for 11 seconds 00000100:00100000:3.0:1788528757.315425:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735614976 00000100:00100000:3.0:1788528757.315429:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735614976 00000100:00100000:3.0:1788528757.315453:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735614592 00000100:00100000:3.0:1788528757.315456:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735614592 00000100:00100000:3.0:1788528757.315467:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735615104 00000100:00100000:3.0:1788528757.315469:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735615104 00000100:00100000:3.0:1788528757.315481:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735614080 00000100:00100000:3.0:1788528757.315484:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735614080 00000100:00100000:3.0:1788528757.315493:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735614720 00000100:00100000:3.0:1788528757.315496:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735614720 00000100:00100000:3.0:1788528757.315505:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735614848 00000100:00100000:3.0:1788528757.315508:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735614848 00000100:00100000:3.0:1788528757.315530:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788528757.315535:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875407735614976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528757.315590:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875407735614976:12345-0@lo:400:kworker.0 Request processed in 55us (2429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528757.315597:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788528757.315610:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788528757.315616:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875407735614592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528757.315641:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875407735614592:12345-0@lo:400:kworker.0 Request processed in 26us (2396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528757.315647:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788528757.315657:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788528757.315662:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875407735615104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528757.315687:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875407735615104:12345-0@lo:400:kworker.0 Request processed in 25us (2403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528757.315692:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788528757.315703:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788528757.315708:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875407735614080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528757.315732:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875407735614080:12345-0@lo:400:kworker.0 Request processed in 24us (2402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528757.315738:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788528757.315748:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788528757.315754:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875407735614720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528757.315777:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875407735614720:12345-0@lo:400:kworker.0 Request processed in 24us (1588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528757.315783:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788528757.315800:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788528757.315805:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875407735614848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528757.315830:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875407735614848:12345-0@lo:400:kworker.0 Request processed in 25us (1514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528757.315836:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788528757.315854:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735613696 00000100:00100000:3.0:1788528757.315857:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735613696 00000100:00100000:3.0:1788528757.315880:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735614208 00000100:00100000:3.0:1788528757.315883:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735614208 00000100:00100000:3.0:1788528757.315894:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788528757.315900:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735613696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528757.315953:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735613696:12345-0@lo:400:kworker.0 Request processed in 41us (2731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528757.315961:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788528757.315973:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788528757.315980:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735614208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528757.316006:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735614208:12345-0@lo:400:kworker.0 Request processed in 27us (1720us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528757.316011:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788528757.316157:0:24215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735615232 00000100:00100000:3.0:1788528757.316161:0:24215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735615232 00000100:00100000:3.0:1788528757.316190:0:24215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788528757.316196:0:24215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1875407735615232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788528757.316209:0:24215:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915862016 avail 3684339712 00000100:00100000:3.0:1788528757.316240:0:24215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1875407735615232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (1998us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528757.316246:0:24215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788528757.316271:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788528757.316275:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788528757.316278:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788528757.316288:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735615488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788528757.316313:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528757.316341:0:24214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735615616 00000100:00100000:3.0:1788528757.316344:0:24214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735615616 00000100:00100000:3.0:1788528757.316376:0:24214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735615872 00000100:00100000:3.0:1788528757.316380:0:24214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735615872 00000100:00100000:3.0:1788528757.316391:0:24214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788528757.316397:0:24214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22730:x1875407735615616:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788528757.316539:0:24216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735615488 00000100:00100000:3.0:1788528757.316543:0:24216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735615488 00000100:00100000:3.0:1788528757.316586:0:24216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788528757.316593:0:24216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1875407735615488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788528757.316607:0:24216:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788528757.316638:0:24216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1875407735615488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528757.316644:0:24216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788528757.316657:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788528757.316659:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788528757.316681:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90ffa4c000 x1875407735615488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528773 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528757.316700:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735615488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788528757.316723:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735615744:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788528757.316745:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528757.316767:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735613696:0@lo:400:kworker.0 00010000:00080000:3.0:1788528757.316788:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc37af480 x1875407735614592/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528757.316797:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875407735614592:0@lo:400:kworker.0 00010000:00080000:3.0:1788528757.316808:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc37ac000 x1875407735615104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528757.316815:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1875407735615104:0@lo:400:kworker.0 00000100:00100000:3.0:1788528757.316825:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4677480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07f6b94a-1259-41bf-8282-a67e1c8aef03:3639:1875407735613568:0@lo:400:kworker.0 00010000:00080000:3.0:1788528757.316837:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc37ad880 x1875407735614336/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788528773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528757.316844:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735614336:0@lo:400:kworker.0 00010000:00080000:3.0:1788528757.316855:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc37ae300 x1875407735614976/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528757.316863:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1875407735614976:0@lo:400:kworker.0 00000100:00100000:3.0:1788528757.316890:0:24216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735615744 00000100:00100000:3.0:1788528757.316893:0:24216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735615744 00000100:00100000:3.0:1788528757.316911:0:24216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788528757.316917:0:24216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3639:x1875407735615744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788528757.316926:0:24216:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915862016 avail 3684339712 00000100:00100000:3.0:1788528757.316967:0:24216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3639:x1875407735615744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528757.316973:0:24216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788528757.317000:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4675500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735614208:0@lo:400:kworker.0 00010000:00080000:3.0:1788528757.317023:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc37ad500 x1875407735614848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528757.317033:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1875407735614848:0@lo:400:kworker.0 00010000:00080000:3.0:1788528757.317043:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90fe692a00 x1875407735615232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528773 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528757.317055:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe692a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735615232:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788528757.317065:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc4674e00 x1875407735614080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528757.317073:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4674e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875407735614080:0@lo:400:kworker.0 00010000:00080000:3.0:1788528757.317083:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc37afb80 x1875407735614720/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528757.317091:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1875407735614720:0@lo:400:kworker.0 00010000:00080000:3.0:1788528757.317121:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90fa8ac380 x1875407735615744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788528773 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528757.317131:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735615744:0@lo:13:osp-pre-1-1.0 00000004:00080000:0.0:1788528757.319114:0:23439:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:0.0:1788528757.321282:0:24213:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1788528757.321294:0:24213:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:0.0:1788528757.321301:0:24213:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00000004:00080000:3.0:1788528757.324908:0:22685:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1788528757.324930:0:22685:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:1.0:1788528757.331611:0:24214:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1788528757.331622:0:24214:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:1.0:1788528757.331628:0:24214:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:65) 00002000:00010000:0.0:1788528757.333203:0:24213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788528757.333213:0:24213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068244a9c/0x892c60dda91c9765 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.333229:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=626s v=(0 0) 00010000:00010000:0.0:1788528757.333234:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788528757.333240:0:24213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068244a9c/0x892c60dda91c9765 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.333257:0:24213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068244a9c/0x892c60dda91c9765 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.333267:0:24213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068244a9c/0x892c60dda91c9765 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.333276:0:24213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068244a9c/0x892c60dda91c9765 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.333301:0:24213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788528757.333312:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528757.333318:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068244a9c/0x892c60dda91c9765 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.333325:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101851c00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528757.333330:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068244a9c/0x892c60dda91c9765 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.333341:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068244a9c/0x892c60dda91c9765 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.333358:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068244a9c/0x892c60dda91c9765 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.333366:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068244a9c/0x892c60dda91c9765 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.333385:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528757.333386:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528757.333388:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788528757.333781:0:24213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788528757.333787:0:24213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ac40608/0x892c60dda91c976c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.333796:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=626s v=(0 0) 00010000:00010000:0.0:1788528757.333804:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788528757.333809:0:24213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ac40608/0x892c60dda91c976c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.333818:0:24213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ac40608/0x892c60dda91c976c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.333827:0:24213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ac40608/0x892c60dda91c976c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.333833:0:24213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ac40608/0x892c60dda91c976c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.333848:0:24213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788528757.333857:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528757.333862:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ac40608/0x892c60dda91c976c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.333869:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101850200 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528757.333872:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ac40608/0x892c60dda91c976c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.333879:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ac40608/0x892c60dda91c976c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.333889:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ac40608/0x892c60dda91c976c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.333906:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ac40608/0x892c60dda91c976c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.333920:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528757.333921:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528757.333923:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788528757.334251:0:24213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788528757.334257:0:24213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c17ff65d/0x892c60dda91c9773 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.334267:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=626s v=(0 0) 00010000:00010000:0.0:1788528757.334270:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788528757.334274:0:24213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c17ff65d/0x892c60dda91c9773 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.334283:0:24213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c17ff65d/0x892c60dda91c9773 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.334291:0:24213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c17ff65d/0x892c60dda91c9773 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.334298:0:24213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c17ff65d/0x892c60dda91c9773 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.334313:0:24213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788528757.334320:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528757.334331:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c17ff65d/0x892c60dda91c9773 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.334338:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101851200 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528757.334341:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c17ff65d/0x892c60dda91c9773 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.334348:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c17ff65d/0x892c60dda91c9773 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.334358:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c17ff65d/0x892c60dda91c9773 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.334364:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c17ff65d/0x892c60dda91c9773 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.334377:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528757.334378:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528757.334380:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788528757.334675:0:24213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788528757.334681:0:24213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030c16d45/0x892c60dda91c977a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.334691:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=626s v=(0 0) 00010000:00010000:0.0:1788528757.334694:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788528757.334698:0:24213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030c16d45/0x892c60dda91c977a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.334717:0:24213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030c16d45/0x892c60dda91c977a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.334725:0:24213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030c16d45/0x892c60dda91c977a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.334732:0:24213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000030c16d45/0x892c60dda91c977a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.334745:0:24213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788528757.334754:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528757.334758:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000030c16d45/0x892c60dda91c977a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.334764:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101851000 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528757.334768:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000030c16d45/0x892c60dda91c977a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.334776:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000030c16d45/0x892c60dda91c977a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.334787:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000030c16d45/0x892c60dda91c977a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.334795:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030c16d45/0x892c60dda91c977a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.334814:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528757.334816:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528757.334817:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788528757.337749:0:24213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788528757.337764:0:24213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038a509d1/0x892c60dda91c9781 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.337779:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=626s v=(0 0) 00010000:00010000:0.0:1788528757.337784:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788528757.337790:0:24213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038a509d1/0x892c60dda91c9781 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.337803:0:24213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038a509d1/0x892c60dda91c9781 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.337813:0:24213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038a509d1/0x892c60dda91c9781 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.337820:0:24213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000038a509d1/0x892c60dda91c9781 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.337845:0:24213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788528757.337863:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528757.337868:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000038a509d1/0x892c60dda91c9781 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.337888:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031800 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528757.337892:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000038a509d1/0x892c60dda91c9781 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.337901:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000038a509d1/0x892c60dda91c9781 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.337917:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000038a509d1/0x892c60dda91c9781 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.337924:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038a509d1/0x892c60dda91c9781 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.337952:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528757.337954:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528757.337956:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788528757.338764:0:24213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788528757.338772:0:24213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084527d05/0x892c60dda91c9788 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.338783:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=626s v=(0 0) 00010000:00010000:0.0:1788528757.338787:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788528757.338792:0:24213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084527d05/0x892c60dda91c9788 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.338803:0:24213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084527d05/0x892c60dda91c9788 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.338820:0:24213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084527d05/0x892c60dda91c9788 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.338827:0:24213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084527d05/0x892c60dda91c9788 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.338880:0:24213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788528757.341631:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788528757.341644:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084527d05/0x892c60dda91c9788 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.341657:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0030c00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528757.341662:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084527d05/0x892c60dda91c9788 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.341679:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084527d05/0x892c60dda91c9788 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.341702:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084527d05/0x892c60dda91c9788 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.341709:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084527d05/0x892c60dda91c9788 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.341732:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528757.341734:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528757.341736:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788528757.342099:0:24213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788528757.342107:0:24213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e94606d1/0x892c60dda91c978f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.342119:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=626s v=(0 0) 00010000:00010000:0.0:1788528757.342122:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788528757.342128:0:24213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e94606d1/0x892c60dda91c978f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.342138:0:24213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e94606d1/0x892c60dda91c978f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.342147:0:24213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e94606d1/0x892c60dda91c978f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.342155:0:24213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e94606d1/0x892c60dda91c978f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.342190:0:24213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788528757.342602:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788528757.342609:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e94606d1/0x892c60dda91c978f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.342618:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031400 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528757.342622:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e94606d1/0x892c60dda91c978f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.342629:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e94606d1/0x892c60dda91c978f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.342642:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e94606d1/0x892c60dda91c978f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.342661:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e94606d1/0x892c60dda91c978f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.342676:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528757.342678:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528757.342680:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788528757.342954:0:24213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788528757.342960:0:24213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b79a2a2/0x892c60dda91c9796 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.342969:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=626s v=(0 0) 00010000:00010000:0.0:1788528757.342972:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788528757.342976:0:24213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b79a2a2/0x892c60dda91c9796 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.342985:0:24213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b79a2a2/0x892c60dda91c9796 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.342993:0:24213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b79a2a2/0x892c60dda91c9796 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.343000:0:24213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b79a2a2/0x892c60dda91c9796 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.343024:0:24213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788528757.343671:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788528757.343679:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b79a2a2/0x892c60dda91c9796 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.343688:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0030800 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528757.343691:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b79a2a2/0x892c60dda91c9796 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.343700:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b79a2a2/0x892c60dda91c9796 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.343713:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b79a2a2/0x892c60dda91c9796 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.343720:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b79a2a2/0x892c60dda91c9796 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.343735:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528757.343737:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528757.343738:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788528757.344258:0:24213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788528757.344265:0:24213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000090b2947/0x892c60dda91c979d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.344275:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=626s v=(0 0) 00010000:00010000:0.0:1788528757.344285:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788528757.344290:0:24213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000090b2947/0x892c60dda91c979d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.344299:0:24213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000090b2947/0x892c60dda91c979d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.344308:0:24213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000090b2947/0x892c60dda91c979d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.344315:0:24213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000090b2947/0x892c60dda91c979d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.344335:0:24213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788528757.344812:0:24213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788528757.344818:0:24213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054738cc3/0x892c60dda91c97a4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.344827:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=626s v=(0 0) 00010000:00010000:0.0:1788528757.344831:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788528757.344835:0:24213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054738cc3/0x892c60dda91c97a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.344844:0:24213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054738cc3/0x892c60dda91c97a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.344852:0:24213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054738cc3/0x892c60dda91c97a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.344864:0:24213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054738cc3/0x892c60dda91c97a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.344879:0:24213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788528757.344888:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788528757.344894:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000090b2947/0x892c60dda91c979d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.344901:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0030200 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528757.344904:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000090b2947/0x892c60dda91c979d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.344912:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000090b2947/0x892c60dda91c979d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.344924:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000090b2947/0x892c60dda91c979d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.344931:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000090b2947/0x892c60dda91c979d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.344958:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528757.344963:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054738cc3/0x892c60dda91c97a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.344982:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0030600 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528757.344986:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054738cc3/0x892c60dda91c97a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.344994:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054738cc3/0x892c60dda91c97a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.345005:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054738cc3/0x892c60dda91c97a4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.345012:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054738cc3/0x892c60dda91c97a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.345025:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528757.345027:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528757.345029:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528757.347753:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788528757.348699:0:24214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788528757.348717:0:24214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383b55f2/0x892c60dda91c97ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.348733:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=626s v=(0 0) 00010000:00010000:1.0:1788528757.348738:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788528757.348744:0:24214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383b55f2/0x892c60dda91c97ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.348761:0:24214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383b55f2/0x892c60dda91c97ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.348772:0:24214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383b55f2/0x892c60dda91c97ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.348780:0:24214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383b55f2/0x892c60dda91c97ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.351058:0:24214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788528757.355585:0:24213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788528757.355600:0:24213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b63d2ea0/0x892c60dda91c97b2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.355617:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=626s v=(0 0) 00010000:00010000:2.0:1788528757.355622:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528757.355628:0:24213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b63d2ea0/0x892c60dda91c97b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.355660:0:24213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b63d2ea0/0x892c60dda91c97b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.355671:0:24213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b63d2ea0/0x892c60dda91c97b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.355680:0:24213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b63d2ea0/0x892c60dda91c97b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.356274:0:24213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788528757.356309:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788528757.356319:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383b55f2/0x892c60dda91c97ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.356331:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c784ea00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528757.356336:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383b55f2/0x892c60dda91c97ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.356348:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383b55f2/0x892c60dda91c97ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.356369:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383b55f2/0x892c60dda91c97ab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.356378:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383b55f2/0x892c60dda91c97ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.356401:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788528757.356406:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b63d2ea0/0x892c60dda91c97b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.356413:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc26e2400 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528757.356416:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b63d2ea0/0x892c60dda91c97b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.356425:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b63d2ea0/0x892c60dda91c97b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.356444:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b63d2ea0/0x892c60dda91c97b2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.356451:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b63d2ea0/0x892c60dda91c97b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.356464:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528757.356466:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528757.356468:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528757.356588:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788528757.357215:0:24213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788528757.357225:0:24213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa14acf8/0x892c60dda91c97b9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.357237:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=626s v=(0 0) 00010000:00010000:2.0:1788528757.357241:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528757.357246:0:24213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa14acf8/0x892c60dda91c97b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.357257:0:24213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa14acf8/0x892c60dda91c97b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.357266:0:24213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa14acf8/0x892c60dda91c97b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.357285:0:24213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa14acf8/0x892c60dda91c97b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.357312:0:24213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788528757.357441:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788528757.357447:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa14acf8/0x892c60dda91c97b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.357454:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc26e3400 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:2.0:1788528757.357457:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa14acf8/0x892c60dda91c97b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.357466:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa14acf8/0x892c60dda91c97b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.357488:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa14acf8/0x892c60dda91c97b9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.357588:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa14acf8/0x892c60dda91c97b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.357607:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528757.357609:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528757.357611:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788528757.357720:0:24213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788528757.357734:0:24213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003504fa4a/0x892c60dda91c97c0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.357743:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=626s v=(0 0) 00010000:00010000:2.0:1788528757.357746:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528757.357750:0:24213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003504fa4a/0x892c60dda91c97c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.357760:0:24213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003504fa4a/0x892c60dda91c97c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.357767:0:24213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003504fa4a/0x892c60dda91c97c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.357773:0:24213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003504fa4a/0x892c60dda91c97c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.357785:0:24213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788528757.358028:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788528757.358035:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003504fa4a/0x892c60dda91c97c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.358044:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc26e3c00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528757.358048:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003504fa4a/0x892c60dda91c97c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.358058:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003504fa4a/0x892c60dda91c97c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.358082:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003504fa4a/0x892c60dda91c97c0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.358091:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003504fa4a/0x892c60dda91c97c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788528757.358102:0:24213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788528757.358110:0:24213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e33383b8/0x892c60dda91c97c7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.358119:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=626s v=(0 0) 00010000:00010000:2.0:1788528757.358122:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528757.358125:0:24213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e33383b8/0x892c60dda91c97c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.358127:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528757.358130:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528757.358134:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528757.358134:0:24213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e33383b8/0x892c60dda91c97c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.358147:0:24213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e33383b8/0x892c60dda91c97c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.358151:0:24213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e33383b8/0x892c60dda91c97c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.358168:0:24213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788528757.358206:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788528757.358212:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e33383b8/0x892c60dda91c97c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.358219:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3ae00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528757.358222:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e33383b8/0x892c60dda91c97c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.358230:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e33383b8/0x892c60dda91c97c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.358242:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e33383b8/0x892c60dda91c97c7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.358248:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e33383b8/0x892c60dda91c97c7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.358261:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528757.358263:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528757.358264:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788528757.358432:0:24213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788528757.358437:0:24213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b52e453c/0x892c60dda91c97ce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.358443:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=626s v=(0 0) 00010000:00010000:2.0:1788528757.358445:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528757.358448:0:24213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b52e453c/0x892c60dda91c97ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.358454:0:24213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b52e453c/0x892c60dda91c97ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.358459:0:24213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b52e453c/0x892c60dda91c97ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.358464:0:24213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b52e453c/0x892c60dda91c97ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.358727:0:24213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788528757.359128:0:24213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788528757.359135:0:24213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2bec8b3/0x892c60dda91c97d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.359144:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=626s v=(0 0) 00010000:00010000:2.0:1788528757.359147:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528757.359151:0:24213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2bec8b3/0x892c60dda91c97d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.359160:0:24213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2bec8b3/0x892c60dda91c97d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.359169:0:24213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2bec8b3/0x892c60dda91c97d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.359176:0:24213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2bec8b3/0x892c60dda91c97d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.359192:0:24213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788528757.359420:0:24213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788528757.359426:0:24213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ea6a60c/0x892c60dda91c97dc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.359435:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=626s v=(0 0) 00010000:00010000:2.0:1788528757.359444:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528757.359448:0:24213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ea6a60c/0x892c60dda91c97dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.359457:0:24213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ea6a60c/0x892c60dda91c97dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.359464:0:24213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ea6a60c/0x892c60dda91c97dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.359471:0:24213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ea6a60c/0x892c60dda91c97dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.359479:0:24213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788528757.359722:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788528757.359729:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b52e453c/0x892c60dda91c97ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.359750:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3b800 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528757.359754:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b52e453c/0x892c60dda91c97ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.359763:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b52e453c/0x892c60dda91c97ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.359779:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b52e453c/0x892c60dda91c97ce lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.359787:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b52e453c/0x892c60dda91c97ce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788528757.360080:0:24214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788528757.360087:0:24214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5bc3d39/0x892c60dda91c97e3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.360096:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=626s v=(0 0) 00010000:00010000:1.0:1788528757.360099:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788528757.360103:0:24214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5bc3d39/0x892c60dda91c97e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.360113:0:24214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5bc3d39/0x892c60dda91c97e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.360126:0:24214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5bc3d39/0x892c60dda91c97e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.360134:0:24214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5bc3d39/0x892c60dda91c97e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.360143:0:24214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788528757.360184:0:24213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788528757.360191:0:24213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034050be3/0x892c60dda91c97ea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.360201:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=626s v=(0 0) 00010000:00010000:2.0:1788528757.360205:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528757.360210:0:24213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034050be3/0x892c60dda91c97ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.360220:0:24213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034050be3/0x892c60dda91c97ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.360228:0:24213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034050be3/0x892c60dda91c97ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.360243:0:24213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034050be3/0x892c60dda91c97ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.360253:0:24213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1788528757.360629:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788528757.360635:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2bec8b3/0x892c60dda91c97d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.360643:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3ac00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528757.360648:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2bec8b3/0x892c60dda91c97d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.360657:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2bec8b3/0x892c60dda91c97d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.360671:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2bec8b3/0x892c60dda91c97d5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788528757.360677:0:24214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788528757.360688:0:24214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acc94ab8/0x892c60dda91c97f1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.360691:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2bec8b3/0x892c60dda91c97d5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.360710:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=626s v=(0 0) 00010000:00010000:1.0:1788528757.360715:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528757.360718:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788528757.360721:0:24214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acc94ab8/0x892c60dda91c97f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.360723:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ea6a60c/0x892c60dda91c97dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.360741:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3a800 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:1.0:1788528757.360742:0:24214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acc94ab8/0x892c60dda91c97f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.360745:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ea6a60c/0x892c60dda91c97dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.360766:0:24214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acc94ab8/0x892c60dda91c97f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.360767:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ea6a60c/0x892c60dda91c97dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.360789:0:24214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acc94ab8/0x892c60dda91c97f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.360793:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ea6a60c/0x892c60dda91c97dc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.360817:0:24214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788528757.362959:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ea6a60c/0x892c60dda91c97dc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.362990:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788528757.362996:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5bc3d39/0x892c60dda91c97e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.363003:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c784f600 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528757.363021:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5bc3d39/0x892c60dda91c97e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.363032:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5bc3d39/0x892c60dda91c97e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.363050:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5bc3d39/0x892c60dda91c97e3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.363056:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5bc3d39/0x892c60dda91c97e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788528757.363292:0:24214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788528757.363310:0:24214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029e63d4d/0x892c60dda91c97f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.363323:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=626s v=(0 0) 00010000:00010000:1.0:1788528757.363328:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788528757.363333:0:24214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029e63d4d/0x892c60dda91c97f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.363346:0:24214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029e63d4d/0x892c60dda91c97f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.363355:0:24214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029e63d4d/0x892c60dda91c97f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.363364:0:24214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029e63d4d/0x892c60dda91c97f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.363376:0:24214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788528757.363621:0:24213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788528757.363629:0:24213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d910469/0x892c60dda91c97ff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.363637:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=626s v=(0 0) 00010000:00010000:2.0:1788528757.363641:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528757.363645:0:24213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d910469/0x892c60dda91c97ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.363654:0:24213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d910469/0x892c60dda91c97ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.363663:0:24213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d910469/0x892c60dda91c97ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.363670:0:24213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d910469/0x892c60dda91c97ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.363918:0:24213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1788528757.364223:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788528757.364229:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034050be3/0x892c60dda91c97ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.364241:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3b000 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528757.364244:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034050be3/0x892c60dda91c97ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.364252:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034050be3/0x892c60dda91c97ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.364267:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034050be3/0x892c60dda91c97ea lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.364274:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034050be3/0x892c60dda91c97ea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.364297:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788528757.364301:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acc94ab8/0x892c60dda91c97f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.364308:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c784fc00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528757.364311:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acc94ab8/0x892c60dda91c97f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.364320:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acc94ab8/0x892c60dda91c97f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.364330:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acc94ab8/0x892c60dda91c97f1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.364337:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acc94ab8/0x892c60dda91c97f1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.364348:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788528757.364352:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029e63d4d/0x892c60dda91c97f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788528757.364686:0:24213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788528757.364693:0:24213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acded3a1/0x892c60dda91c9806 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.364708:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=626s v=(0 0) 00010000:00010000:2.0:1788528757.364712:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528757.364718:0:24213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acded3a1/0x892c60dda91c9806 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.364728:0:24213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000acded3a1/0x892c60dda91c9806 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.364738:0:24213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acded3a1/0x892c60dda91c9806 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.364746:0:24213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000acded3a1/0x892c60dda91c9806 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.364755:0:24213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788528757.364791:0:24214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788528757.364799:0:24214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e371e986/0x892c60dda91c980d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.364807:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=626s v=(0 0) 00010000:00010000:1.0:1788528757.364816:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788528757.364820:0:24214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e371e986/0x892c60dda91c980d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.364831:0:24214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e371e986/0x892c60dda91c980d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.364838:0:24214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e371e986/0x892c60dda91c980d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.365110:0:24214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e371e986/0x892c60dda91c980d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.365122:0:24214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788528757.365577:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c784fe00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528757.365582:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029e63d4d/0x892c60dda91c97f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.365603:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029e63d4d/0x892c60dda91c97f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.365618:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029e63d4d/0x892c60dda91c97f8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.365626:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029e63d4d/0x892c60dda91c97f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.365644:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788528757.365649:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d910469/0x892c60dda91c97ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.365656:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3a400 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528757.365659:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d910469/0x892c60dda91c97ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.365666:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d910469/0x892c60dda91c97ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.365677:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d910469/0x892c60dda91c97ff lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.365685:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d910469/0x892c60dda91c97ff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.365711:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788528757.365714:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000acded3a1/0x892c60dda91c9806 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.365721:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3b200 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528757.365724:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000acded3a1/0x892c60dda91c9806 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.365732:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000acded3a1/0x892c60dda91c9806 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.365741:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000acded3a1/0x892c60dda91c9806 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.365748:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000acded3a1/0x892c60dda91c9806 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.365759:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788528757.365763:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e371e986/0x892c60dda91c980d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.365768:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c1550a00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528757.365771:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e371e986/0x892c60dda91c980d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.365790:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e371e986/0x892c60dda91c980d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.365800:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e371e986/0x892c60dda91c980d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788528757.366179:0:24214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788528757.366187:0:24214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c7d4e3d/0x892c60dda91c9814 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788528757.366350:0:24213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788528757.366357:0:24213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8d3aa4a/0x892c60dda91c981b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.366365:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=626s v=(0 0) 00010000:00010000:2.0:1788528757.366369:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528757.366374:0:24213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8d3aa4a/0x892c60dda91c981b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.366384:0:24213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8d3aa4a/0x892c60dda91c981b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.366404:0:24213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8d3aa4a/0x892c60dda91c981b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.366413:0:24213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8d3aa4a/0x892c60dda91c981b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.366422:0:24213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788528757.366506:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=626s v=(0 0) 00010000:00010000:1.0:1788528757.366511:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788528757.366515:0:24214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c7d4e3d/0x892c60dda91c9814 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.366526:0:24214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c7d4e3d/0x892c60dda91c9814 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.366536:0:24214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c7d4e3d/0x892c60dda91c9814 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.366542:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e371e986/0x892c60dda91c980d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.366574:0:24214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c7d4e3d/0x892c60dda91c9814 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.366589:0:24214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788528757.366593:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788528757.366598:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8d3aa4a/0x892c60dda91c981b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.366605:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3b400 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528757.366609:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8d3aa4a/0x892c60dda91c981b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.366617:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8d3aa4a/0x892c60dda91c981b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.366629:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8d3aa4a/0x892c60dda91c981b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.366636:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8d3aa4a/0x892c60dda91c981b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.366664:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788528757.366667:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c7d4e3d/0x892c60dda91c9814 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.366673:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c1551400 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528757.366676:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c7d4e3d/0x892c60dda91c9814 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.366685:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c7d4e3d/0x892c60dda91c9814 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.366695:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c7d4e3d/0x892c60dda91c9814 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.366703:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c7d4e3d/0x892c60dda91c9814 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.366716:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528757.366718:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528757.366720:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528757.367028:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788528757.367382:0:24214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788528757.367388:0:24214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000624b3072/0x892c60dda91c9822 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.367398:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=626s v=(0 0) 00010000:00010000:1.0:1788528757.367402:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788528757.367406:0:24214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000624b3072/0x892c60dda91c9822 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.367415:0:24214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000624b3072/0x892c60dda91c9822 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.367434:0:24214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000624b3072/0x892c60dda91c9822 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.367441:0:24214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000624b3072/0x892c60dda91c9822 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.367460:0:24214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788528757.367707:0:24214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528757.367713:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788528757.367714:0:24214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf0ff73e/0x892c60dda91c9829 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.367721:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000624b3072/0x892c60dda91c9822 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.367733:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=626s v=(0 0) 00010000:00010000:1.0:1788528757.367740:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528757.367745:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c1551800 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:1.0:1788528757.367747:0:24214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf0ff73e/0x892c60dda91c9829 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.367758:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000624b3072/0x892c60dda91c9822 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.367761:0:24214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf0ff73e/0x892c60dda91c9829 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.367775:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000624b3072/0x892c60dda91c9822 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.367778:0:24214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf0ff73e/0x892c60dda91c9829 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.367792:0:24214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf0ff73e/0x892c60dda91c9829 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.367795:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000624b3072/0x892c60dda91c9822 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.367812:0:24214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788528757.367948:0:24213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788528757.367955:0:24213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092d51e51/0x892c60dda91c9830 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.367965:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=626s v=(0 0) 00010000:00010000:2.0:1788528757.367968:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528757.367973:0:24213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092d51e51/0x892c60dda91c9830 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.367982:0:24213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092d51e51/0x892c60dda91c9830 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.367990:0:24213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092d51e51/0x892c60dda91c9830 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.367998:0:24213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092d51e51/0x892c60dda91c9830 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.368017:0:24213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788528757.368672:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000624b3072/0x892c60dda91c9822 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.368691:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788528757.368695:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf0ff73e/0x892c60dda91c9829 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.368703:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c1551a00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528757.368706:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf0ff73e/0x892c60dda91c9829 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.368714:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf0ff73e/0x892c60dda91c9829 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.368726:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf0ff73e/0x892c60dda91c9829 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.368733:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf0ff73e/0x892c60dda91c9829 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.368756:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788528757.368760:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092d51e51/0x892c60dda91c9830 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.368766:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3bc00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528757.368770:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092d51e51/0x892c60dda91c9830 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.368777:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092d51e51/0x892c60dda91c9830 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.368787:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092d51e51/0x892c60dda91c9830 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.368793:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092d51e51/0x892c60dda91c9830 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788528757.368994:0:24214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788528757.369001:0:24214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059d3173f/0x892c60dda91c9837 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.369010:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=626s v=(0 0) 00010000:00010000:1.0:1788528757.369014:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788528757.369018:0:24214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059d3173f/0x892c60dda91c9837 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.369028:0:24214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059d3173f/0x892c60dda91c9837 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.369047:0:24214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059d3173f/0x892c60dda91c9837 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.369054:0:24214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059d3173f/0x892c60dda91c9837 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.369062:0:24214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788528757.369140:0:24213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788528757.369146:0:24213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab471fbf/0x892c60dda91c983e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.369153:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=626s v=(0 0) 00010000:00010000:2.0:1788528757.369157:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528757.369160:0:24213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab471fbf/0x892c60dda91c983e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.369169:0:24213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab471fbf/0x892c60dda91c983e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.369176:0:24213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab471fbf/0x892c60dda91c983e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.369183:0:24213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab471fbf/0x892c60dda91c983e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.369191:0:24213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788528757.369284:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788528757.369537:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788528757.369542:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab471fbf/0x892c60dda91c983e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.369550:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3aa00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528757.369582:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab471fbf/0x892c60dda91c983e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.369605:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab471fbf/0x892c60dda91c983e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.369618:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab471fbf/0x892c60dda91c983e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.369626:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab471fbf/0x892c60dda91c983e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.369642:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528757.369644:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528757.369646:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788528757.370671:0:24214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528757.370680:0:24214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b03fdc15/0x892c60dda91c9845 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.370691:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1788528757.370696:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528757.370701:0:24214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b03fdc15/0x892c60dda91c9845 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.370711:0:24214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b03fdc15/0x892c60dda91c9845 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.370720:0:24214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b03fdc15/0x892c60dda91c9845 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.370734:0:24214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b03fdc15/0x892c60dda91c9845 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.370749:0:24214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788528757.370954:0:24213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788528757.370961:0:24213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7acb767/0x892c60dda91c984c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.370969:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=626s v=(0 0) 00010000:00010000:2.0:1788528757.370978:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528757.370983:0:24213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7acb767/0x892c60dda91c984c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.370993:0:24213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7acb767/0x892c60dda91c984c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.371001:0:24213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7acb767/0x892c60dda91c984c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.371008:0:24213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7acb767/0x892c60dda91c984c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.371016:0:24213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788528757.372623:0:24214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528757.372635:0:24214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3c86653/0x892c60dda91c9853 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.372649:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1788528757.372654:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528757.372659:0:24214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3c86653/0x892c60dda91c9853 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.372671:0:24214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3c86653/0x892c60dda91c9853 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.372681:0:24214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3c86653/0x892c60dda91c9853 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.372689:0:24214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3c86653/0x892c60dda91c9853 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.372699:0:24214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788528757.372986:0:24213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788528757.372993:0:24213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061d5c23f/0x892c60dda91c985a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.373002:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=626s v=(0 0) 00010000:00010000:2.0:1788528757.373005:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528757.373009:0:24213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061d5c23f/0x892c60dda91c985a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.373018:0:24213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061d5c23f/0x892c60dda91c985a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.373027:0:24213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061d5c23f/0x892c60dda91c985a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.373041:0:24213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061d5c23f/0x892c60dda91c985a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.373050:0:24213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788528757.373649:0:24214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528757.373657:0:24214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1748f4d/0x892c60dda91c9861 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.373673:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1788528757.373677:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528757.373682:0:24214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1748f4d/0x892c60dda91c9861 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.373692:0:24214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1748f4d/0x892c60dda91c9861 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.373701:0:24214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1748f4d/0x892c60dda91c9861 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.373708:0:24214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1748f4d/0x892c60dda91c9861 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.373718:0:24214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1788528757.374661:0:24213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788528757.374670:0:24213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000256db332/0x892c60dda91c9868 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.374681:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=626s v=(0 0) 00010000:00010000:2.0:1788528757.374685:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528757.374689:0:24213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000256db332/0x892c60dda91c9868 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.374701:0:24213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000256db332/0x892c60dda91c9868 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.374709:0:24213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000256db332/0x892c60dda91c9868 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.374716:0:24213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000256db332/0x892c60dda91c9868 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.374725:0:24213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1788528757.375131:0:24214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528757.375138:0:24214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c553e085/0x892c60dda91c986f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.375147:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1788528757.375151:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528757.375155:0:24214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c553e085/0x892c60dda91c986f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.375165:0:24214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c553e085/0x892c60dda91c986f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.375185:0:24214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c553e085/0x892c60dda91c986f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.375192:0:24214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c553e085/0x892c60dda91c986f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.375201:0:24214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:3.0:1788528757.375306:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788528757.375313:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b03fdc15/0x892c60dda91c9845 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.375320:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c6c83800 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528757.375325:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b03fdc15/0x892c60dda91c9845 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.375333:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b03fdc15/0x892c60dda91c9845 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.375349:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b03fdc15/0x892c60dda91c9845 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.375357:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b03fdc15/0x892c60dda91c9845 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.375376:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788528757.375386:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7acb767/0x892c60dda91c984c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.375393:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3a600 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528757.375397:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7acb767/0x892c60dda91c984c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.375405:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7acb767/0x892c60dda91c984c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.375416:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7acb767/0x892c60dda91c984c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.375424:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7acb767/0x892c60dda91c984c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.375437:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788528757.375441:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3c86653/0x892c60dda91c9853 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.375447:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c6c82000 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528757.375451:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3c86653/0x892c60dda91c9853 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788528757.377917:0:24213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788528757.377930:0:24213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c07d1be/0x892c60dda91c9876 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.377966:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=626s v=(0 0) 00010000:00010000:2.0:1788528757.377971:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528757.377978:0:24213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c07d1be/0x892c60dda91c9876 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.377992:0:24213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c07d1be/0x892c60dda91c9876 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.378002:0:24213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c07d1be/0x892c60dda91c9876 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.378011:0:24213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c07d1be/0x892c60dda91c9876 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.378022:0:24213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:3.0:1788528757.378260:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3c86653/0x892c60dda91c9853 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.378292:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3c86653/0x892c60dda91c9853 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.378300:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3c86653/0x892c60dda91c9853 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.378320:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788528757.378325:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061d5c23f/0x892c60dda91c985a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.378333:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3ba00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528757.378337:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061d5c23f/0x892c60dda91c985a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.378346:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061d5c23f/0x892c60dda91c985a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.378356:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061d5c23f/0x892c60dda91c985a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.378364:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061d5c23f/0x892c60dda91c985a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.378376:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788528757.378381:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1748f4d/0x892c60dda91c9861 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.378393:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c6c83e00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528757.378397:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1748f4d/0x892c60dda91c9861 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.378406:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1748f4d/0x892c60dda91c9861 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.378416:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1748f4d/0x892c60dda91c9861 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.378424:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1748f4d/0x892c60dda91c9861 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.378437:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788528757.378441:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000256db332/0x892c60dda91c9868 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.378448:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3b600 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528757.378451:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000256db332/0x892c60dda91c9868 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.378459:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000256db332/0x892c60dda91c9868 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.378469:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000256db332/0x892c60dda91c9868 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.378483:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000256db332/0x892c60dda91c9868 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.378496:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788528757.378500:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c553e085/0x892c60dda91c986f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.378507:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c6c82200 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528757.378510:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c553e085/0x892c60dda91c986f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.378518:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c553e085/0x892c60dda91c986f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.378527:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c553e085/0x892c60dda91c986f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.378535:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c553e085/0x892c60dda91c986f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.378548:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788528757.378574:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c07d1be/0x892c60dda91c9876 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.378583:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3be00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528757.378591:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c07d1be/0x892c60dda91c9876 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.378600:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c07d1be/0x892c60dda91c9876 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.378611:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c07d1be/0x892c60dda91c9876 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.378620:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c07d1be/0x892c60dda91c9876 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.378638:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528757.378641:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528757.378643:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528757.379756:0:25102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528757.379771:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059d3173f/0x892c60dda91c9837 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.379783:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c1551e00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528757.379787:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059d3173f/0x892c60dda91c9837 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.379796:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059d3173f/0x892c60dda91c9837 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.379822:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059d3173f/0x892c60dda91c9837 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.379837:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059d3173f/0x892c60dda91c9837 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.379857:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528757.379859:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528757.379861:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528757.379867:0:25102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528757.379868:0:25102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788528757.380713:0:24214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788528757.380723:0:24214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ffbf1e6/0x892c60dda91c987d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.380735:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=626s v=(0 0) 00010000:00010000:2.0:1788528757.380740:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528757.380746:0:24214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ffbf1e6/0x892c60dda91c987d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.380760:0:24214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ffbf1e6/0x892c60dda91c987d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.380782:0:24214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ffbf1e6/0x892c60dda91c987d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.380790:0:24214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ffbf1e6/0x892c60dda91c987d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788528757.380955:0:24213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528757.380962:0:24213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005476dc0b/0x892c60dda91c9884 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.380971:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1788528757.380974:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528757.380979:0:24213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005476dc0b/0x892c60dda91c9884 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.380989:0:24213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005476dc0b/0x892c60dda91c9884 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.380997:0:24213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005476dc0b/0x892c60dda91c9884 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.381005:0:24213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005476dc0b/0x892c60dda91c9884 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.381046:0:24214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788528757.381972:0:24213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788528757.381989:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788528757.381997:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ffbf1e6/0x892c60dda91c987d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.382008:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3a200 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528757.382013:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ffbf1e6/0x892c60dda91c987d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.382023:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ffbf1e6/0x892c60dda91c987d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.382040:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ffbf1e6/0x892c60dda91c987d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.382047:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ffbf1e6/0x892c60dda91c987d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788528757.382187:0:24214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788528757.382193:0:24214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fe1b0e3/0x892c60dda91c988b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.382202:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=626s v=(0 0) 00010000:00010000:2.0:1788528757.382206:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528757.382211:0:24214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fe1b0e3/0x892c60dda91c988b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.382220:0:24214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fe1b0e3/0x892c60dda91c988b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.382229:0:24214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fe1b0e3/0x892c60dda91c988b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.382237:0:24214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006fe1b0e3/0x892c60dda91c988b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.382264:0:24214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788528757.382548:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788528757.382573:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005476dc0b/0x892c60dda91c9884 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.382582:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c6c82400 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528757.382585:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005476dc0b/0x892c60dda91c9884 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.382606:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005476dc0b/0x892c60dda91c9884 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.382618:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005476dc0b/0x892c60dda91c9884 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.382627:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005476dc0b/0x892c60dda91c9884 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.382643:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788528757.382647:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006fe1b0e3/0x892c60dda91c988b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.382653:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3a000 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528757.382657:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006fe1b0e3/0x892c60dda91c988b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.382665:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006fe1b0e3/0x892c60dda91c988b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.382674:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006fe1b0e3/0x892c60dda91c988b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.382681:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fe1b0e3/0x892c60dda91c988b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.382705:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528757.382707:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528757.382709:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788528757.383347:0:24213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528757.383355:0:24213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000561b9832/0x892c60dda91c9892 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.383365:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1788528757.383369:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528757.383373:0:24213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000561b9832/0x892c60dda91c9892 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.383382:0:24213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000561b9832/0x892c60dda91c9892 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.383390:0:24213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000561b9832/0x892c60dda91c9892 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.383398:0:24213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000561b9832/0x892c60dda91c9892 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.383417:0:24213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788528757.383427:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788528757.383431:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000561b9832/0x892c60dda91c9892 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.383448:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c6c82e00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528757.383452:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000561b9832/0x892c60dda91c9892 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788528757.384007:0:24214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788528757.384016:0:24214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd78cf69/0x892c60dda91c9899 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.384026:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=626s v=(0 0) 00010000:00010000:2.0:1788528757.384030:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528757.384034:0:24214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd78cf69/0x892c60dda91c9899 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.384045:0:24214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd78cf69/0x892c60dda91c9899 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.384053:0:24214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd78cf69/0x892c60dda91c9899 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.384061:0:24214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd78cf69/0x892c60dda91c9899 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.384161:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000561b9832/0x892c60dda91c9892 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.384177:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000561b9832/0x892c60dda91c9892 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.384184:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000561b9832/0x892c60dda91c9892 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.384202:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528757.384204:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528757.384206:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528757.384443:0:24214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788528757.384633:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788528757.384641:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd78cf69/0x892c60dda91c9899 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.384651:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c68dae00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:1.0:1788528757.384655:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd78cf69/0x892c60dda91c9899 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.384664:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd78cf69/0x892c60dda91c9899 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.384677:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd78cf69/0x892c60dda91c9899 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.384685:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd78cf69/0x892c60dda91c9899 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.384703:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528757.384711:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528757.384713:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788528757.385708:0:24213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528757.385720:0:24213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a901f56/0x892c60dda91c98a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.385734:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1788528757.385738:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528757.385743:0:24213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a901f56/0x892c60dda91c98a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.385756:0:24213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a901f56/0x892c60dda91c98a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.385775:0:24213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a901f56/0x892c60dda91c98a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.385783:0:24213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a901f56/0x892c60dda91c98a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.385802:0:24213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788528757.386283:0:25102:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788528757.386288:0:25102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a901f56/0x892c60dda91c98a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.386296:0:25102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c6c83400 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528757.386300:0:25102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a901f56/0x892c60dda91c98a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.386309:0:25102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a901f56/0x892c60dda91c98a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.386324:0:25102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a901f56/0x892c60dda91c98a0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.386332:0:25102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a901f56/0x892c60dda91c98a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.386351:0:25102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528757.386359:0:25102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528757.386361:0:25102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788528757.386930:0:24214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788528757.386948:0:24214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea4d291c/0x892c60dda91c98a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.386959:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=626s v=(0 0) 00010000:00010000:2.0:1788528757.386969:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528757.386975:0:24214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea4d291c/0x892c60dda91c98a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.386986:0:24214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea4d291c/0x892c60dda91c98a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.386996:0:24214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea4d291c/0x892c60dda91c98a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.387002:0:24214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea4d291c/0x892c60dda91c98a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.387017:0:24214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788528757.387142:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788528757.387148:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea4d291c/0x892c60dda91c98a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.387155:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c68db000 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:2.0:1788528757.387158:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea4d291c/0x892c60dda91c98a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.387166:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea4d291c/0x892c60dda91c98a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.387179:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea4d291c/0x892c60dda91c98a7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.387198:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea4d291c/0x892c60dda91c98a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.387216:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528757.387218:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528757.387219:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528757.388610:0:25102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788528757.388992:0:24213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788528757.389002:0:24213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010d36579/0x892c60dda91c98ae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.389018:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=626s v=(0 0) 00010000:00010000:2.0:1788528757.389022:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528757.389027:0:24213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010d36579/0x892c60dda91c98ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.389041:0:24213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010d36579/0x892c60dda91c98ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.389050:0:24213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010d36579/0x892c60dda91c98ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.389058:0:24213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000010d36579/0x892c60dda91c98ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.389073:0:24213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788528757.389082:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788528757.389095:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000010d36579/0x892c60dda91c98ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.389102:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c68da000 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:2.0:1788528757.389106:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000010d36579/0x892c60dda91c98ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.389114:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000010d36579/0x892c60dda91c98ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.389127:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000010d36579/0x892c60dda91c98ae lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.389134:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010d36579/0x892c60dda91c98ae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.389148:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528757.389150:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528757.389151:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788528757.389216:0:24213:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:2.0:1788528757.389302:0:24213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe690000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22732:x1875407735615360:12345-0@lo:5:osp-pre-1-0.0 Request processed in 74601us (75536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528757.389311:0:24213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788528757.389369:0:22732:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe693480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22732:1875407735615360:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788528757.389385:0:22732:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:2.0:1788528757.389427:0:22732:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6bc9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22732:1875407735616000:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788528757.389482:0:22732:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528757.389507:0:22732:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90cea86780 going to sleep for 11 seconds 00000100:00100000:2.0:1788528757.389525:0:24794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735616000 00000100:00100000:2.0:1788528757.389530:0:24794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735616000 00000100:00100000:2.0:1788528757.389589:0:24794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788528757.389598:0:24794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23451:x1875407735615872:12345-0@lo:7:osp-pre-1-1.0 00002000:00010000:3.0:1788528757.390233:0:24214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528757.390241:0:24214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000685aa64d/0x892c60dda91c98b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.390252:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1788528757.390256:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528757.390261:0:24214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000685aa64d/0x892c60dda91c98b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.390271:0:24214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000685aa64d/0x892c60dda91c98b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.390281:0:24214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000685aa64d/0x892c60dda91c98b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.390289:0:24214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000685aa64d/0x892c60dda91c98b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.390306:0:24214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788528757.390692:0:24214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528757.390697:0:24214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b8df422/0x892c60dda91c98bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.390705:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1788528757.390708:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528757.390720:0:24214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b8df422/0x892c60dda91c98bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.390729:0:24214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b8df422/0x892c60dda91c98bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.390738:0:24214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b8df422/0x892c60dda91c98bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.390744:0:24214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b8df422/0x892c60dda91c98bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.390756:0:24214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788528757.391077:0:24214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528757.391083:0:24214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab471fbf/0x892c60dda91c98c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.391091:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1788528757.391094:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528757.391098:0:24214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab471fbf/0x892c60dda91c98c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.391107:0:24214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab471fbf/0x892c60dda91c98c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.391114:0:24214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab471fbf/0x892c60dda91c98c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.391133:0:24214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab471fbf/0x892c60dda91c98c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.391140:0:24214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788528757.391419:0:24214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528757.391424:0:24214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092d51e51/0x892c60dda91c98ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.391433:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1788528757.391436:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528757.391440:0:24214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092d51e51/0x892c60dda91c98ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.391450:0:24214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092d51e51/0x892c60dda91c98ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.391902:0:24214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092d51e51/0x892c60dda91c98ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.391913:0:24214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092d51e51/0x892c60dda91c98ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.391923:0:24214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788528757.393221:0:24214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528757.393231:0:24214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8d3aa4a/0x892c60dda91c98d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.393252:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1788528757.393257:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528757.393262:0:24214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8d3aa4a/0x892c60dda91c98d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.393275:0:24214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8d3aa4a/0x892c60dda91c98d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.393285:0:24214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8d3aa4a/0x892c60dda91c98d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.393292:0:24214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8d3aa4a/0x892c60dda91c98d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.393301:0:24214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1788528757.397166:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788528757.397179:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000685aa64d/0x892c60dda91c98b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.397193:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c6c83c00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:2.0:1788528757.397198:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000685aa64d/0x892c60dda91c98b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.397210:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000685aa64d/0x892c60dda91c98b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.397229:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000685aa64d/0x892c60dda91c98b5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.397237:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000685aa64d/0x892c60dda91c98b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.397261:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788528757.397265:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b8df422/0x892c60dda91c98bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.397283:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c6c82800 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:2.0:1788528757.397286:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b8df422/0x892c60dda91c98bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.397293:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b8df422/0x892c60dda91c98bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.397303:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b8df422/0x892c60dda91c98bc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.397311:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b8df422/0x892c60dda91c98bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.397324:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788528757.397328:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab471fbf/0x892c60dda91c98c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.397334:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3aa00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:2.0:1788528757.397338:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab471fbf/0x892c60dda91c98c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.397344:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab471fbf/0x892c60dda91c98c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.397353:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab471fbf/0x892c60dda91c98c3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.397366:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab471fbf/0x892c60dda91c98c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.397380:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788528757.397383:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092d51e51/0x892c60dda91c98ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.397390:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3bc00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:2.0:1788528757.397393:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092d51e51/0x892c60dda91c98ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.397402:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092d51e51/0x892c60dda91c98ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.397412:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092d51e51/0x892c60dda91c98ca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.397419:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092d51e51/0x892c60dda91c98ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.397430:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788528757.397434:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8d3aa4a/0x892c60dda91c98d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.397440:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3b400 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:2.0:1788528757.397448:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8d3aa4a/0x892c60dda91c98d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.397457:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8d3aa4a/0x892c60dda91c98d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.397467:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8d3aa4a/0x892c60dda91c98d1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.397475:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8d3aa4a/0x892c60dda91c98d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.397487:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528757.397489:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528757.397491:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528757.397499:0:25102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528757.397658:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788528757.398094:0:24214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528757.398103:0:24214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acded3a1/0x892c60dda91c98d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.398116:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1788528757.398121:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528757.398127:0:24214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acded3a1/0x892c60dda91c98d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.398139:0:24214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acded3a1/0x892c60dda91c98d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.398161:0:24214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acded3a1/0x892c60dda91c98d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.398170:0:24214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acded3a1/0x892c60dda91c98d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.398195:0:24214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788528757.398225:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788528757.398232:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acded3a1/0x892c60dda91c98d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.398241:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3b200 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:1.0:1788528757.398246:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acded3a1/0x892c60dda91c98d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.398253:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acded3a1/0x892c60dda91c98d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.398267:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acded3a1/0x892c60dda91c98d8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.398274:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acded3a1/0x892c60dda91c98d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.398291:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528757.398294:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528757.398295:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788528757.398609:0:24214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528757.398616:0:24214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d910469/0x892c60dda91c98df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.398625:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1788528757.398628:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528757.398633:0:24214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d910469/0x892c60dda91c98df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.398643:0:24214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d910469/0x892c60dda91c98df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.398651:0:24214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d910469/0x892c60dda91c98df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.398659:0:24214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d910469/0x892c60dda91c98df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.398684:0:24214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788528757.398990:0:24214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528757.398996:0:24214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034050be3/0x892c60dda91c98e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.399004:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1788528757.399007:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528757.399011:0:24214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034050be3/0x892c60dda91c98e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.399020:0:24214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034050be3/0x892c60dda91c98e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.399028:0:24214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034050be3/0x892c60dda91c98e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.399035:0:24214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034050be3/0x892c60dda91c98e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.399048:0:24214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:3.0:1788528757.400604:0:24794:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1788528757.400614:0:24794:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788528757.400696:0:24794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23451:x1875407735615872:12345-0@lo:7:osp-pre-1-1.0 Request processed in 11096us (85291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528757.400706:0:24794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788528757.400737:0:24794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788528757.400755:0:24794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22732:x1875407735616000:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788528757.400792:0:24794:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:3.0:1788528757.400930:0:23451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ace00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23451:1875407735615872:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1788528757.400953:0:23451:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788528757.400986:0:23451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ace00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23451:1875407735616128:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1788528757.401015:0:23451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528757.401036:0:23451:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90de607e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788528757.401049:0:24212:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788528757.401054:0:24212:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00002000:00010000:3.0:1788528757.401180:0:24214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528757.401187:0:24214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ea6a60c/0x892c60dda91c98ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.401201:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1788528757.401205:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528757.401211:0:24214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ea6a60c/0x892c60dda91c98ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.401222:0:24214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ea6a60c/0x892c60dda91c98ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.401232:0:24214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ea6a60c/0x892c60dda91c98ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.401240:0:24214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ea6a60c/0x892c60dda91c98ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.401264:0:24214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788528757.401375:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788528757.401382:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d910469/0x892c60dda91c98df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.401390:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3a400 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528757.401395:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d910469/0x892c60dda91c98df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.401405:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d910469/0x892c60dda91c98df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.401419:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d910469/0x892c60dda91c98df lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.401427:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d910469/0x892c60dda91c98df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.401443:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788528757.401447:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034050be3/0x892c60dda91c98e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.401453:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3b000 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528757.401466:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034050be3/0x892c60dda91c98e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.401484:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034050be3/0x892c60dda91c98e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.401494:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034050be3/0x892c60dda91c98e6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.401501:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034050be3/0x892c60dda91c98e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.401513:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788528757.401516:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ea6a60c/0x892c60dda91c98ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.401522:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3a800 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:3.0:1788528757.401525:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ea6a60c/0x892c60dda91c98ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.401532:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ea6a60c/0x892c60dda91c98ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.401540:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ea6a60c/0x892c60dda91c98ed lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.401547:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ea6a60c/0x892c60dda91c98ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.401594:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528757.401596:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528757.401598:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528757.405430:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528757.405602:0:25102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788528757.409904:0:24214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788528757.409916:0:24214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000085b3c8e/0x892c60dda91c98f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.409932:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=626s v=(0 0) 00010000:00010000:2.0:1788528757.409937:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528757.409954:0:24214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000085b3c8e/0x892c60dda91c98f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.409968:0:24214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000085b3c8e/0x892c60dda91c98f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.409993:0:24214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000085b3c8e/0x892c60dda91c98f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.410001:0:24214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000085b3c8e/0x892c60dda91c98f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.410018:0:24214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788528757.410951:0:24214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788528757.410959:0:24214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bcedd60/0x892c60dda91c98fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.410970:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=626s v=(0 0) 00010000:00010000:2.0:1788528757.410974:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528757.410980:0:24214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bcedd60/0x892c60dda91c98fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.410990:0:24214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bcedd60/0x892c60dda91c98fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.411000:0:24214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bcedd60/0x892c60dda91c98fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.411008:0:24214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008bcedd60/0x892c60dda91c98fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.411036:0:24214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788528757.411061:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788528757.411070:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000085b3c8e/0x892c60dda91c98f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.411091:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c68dac00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:1.0:1788528757.411096:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000085b3c8e/0x892c60dda91c98f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.411105:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000085b3c8e/0x892c60dda91c98f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.411121:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000085b3c8e/0x892c60dda91c98f4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.411129:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000085b3c8e/0x892c60dda91c98f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.411145:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788528757.411149:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008bcedd60/0x892c60dda91c98fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.411155:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c68db200 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:1.0:1788528757.411158:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008bcedd60/0x892c60dda91c98fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.411165:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008bcedd60/0x892c60dda91c98fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.411176:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008bcedd60/0x892c60dda91c98fb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.411190:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bcedd60/0x892c60dda91c98fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528757.411207:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528757.411209:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528757.411211:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788528757.412689:0:24214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788528757.412702:0:24214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4771104/0x892c60dda91c9902 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.412716:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=626s v=(0 0) 00010000:00010000:2.0:1788528757.412721:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528757.412726:0:24214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4771104/0x892c60dda91c9902 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.412740:0:24214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4771104/0x892c60dda91c9902 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.412749:0:24214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4771104/0x892c60dda91c9902 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.412757:0:24214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4771104/0x892c60dda91c9902 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.412776:0:24214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788528757.413401:0:25102:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788528757.413410:0:25102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4771104/0x892c60dda91c9902 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.413419:0:25102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c68db600 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:2.0:1788528757.413430:0:25102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4771104/0x892c60dda91c9902 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.413441:0:25102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4771104/0x892c60dda91c9902 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.413534:0:25102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4771104/0x892c60dda91c9902 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.413543:0:25102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4771104/0x892c60dda91c9902 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.413586:0:25102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528757.413589:0:25102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528757.413590:0:25102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788528757.413934:0:24214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788528757.413952:0:24214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b53b18c/0x892c60dda91c9909 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.413960:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=626s v=(0 0) 00010000:00010000:2.0:1788528757.413964:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528757.413968:0:24214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b53b18c/0x892c60dda91c9909 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.413978:0:24214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b53b18c/0x892c60dda91c9909 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.413987:0:24214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b53b18c/0x892c60dda91c9909 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.414003:0:24214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b53b18c/0x892c60dda91c9909 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.414024:0:24214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788528757.414346:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528757.414352:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b53b18c/0x892c60dda91c9909 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.414361:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c68daa00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528757.414365:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b53b18c/0x892c60dda91c9909 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.414374:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b53b18c/0x892c60dda91c9909 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.414397:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b53b18c/0x892c60dda91c9909 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.414405:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b53b18c/0x892c60dda91c9909 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.414420:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528757.414422:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528757.414424:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788528757.414595:0:24214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788528757.414601:0:24214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e821e85/0x892c60dda91c9910 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.414610:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=626s v=(0 0) 00010000:00010000:2.0:1788528757.414613:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528757.414617:0:24214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e821e85/0x892c60dda91c9910 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.414626:0:24214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e821e85/0x892c60dda91c9910 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.414633:0:24214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e821e85/0x892c60dda91c9910 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.414639:0:24214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e821e85/0x892c60dda91c9910 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.414653:0:24214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788528757.414742:0:25102:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788528757.414747:0:25102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e821e85/0x892c60dda91c9910 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.414759:0:25102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c68da800 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:2.0:1788528757.414763:0:25102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e821e85/0x892c60dda91c9910 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.414772:0:25102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e821e85/0x892c60dda91c9910 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.414784:0:25102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e821e85/0x892c60dda91c9910 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.414791:0:25102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e821e85/0x892c60dda91c9910 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528757.415192:0:24212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735616128 00000100:00100000:3.0:1788528757.415201:0:24212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735616128 00010000:00010000:3.0:1788528757.415249:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788528757.415979:0:24214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788528757.415988:0:24214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fe1b0e3/0x892c60dda91c9917 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.416000:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1788528757.416004:0:24214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528757.416009:0:24214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fe1b0e3/0x892c60dda91c9917 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.416018:0:24214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fe1b0e3/0x892c60dda91c9917 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.416027:0:24214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fe1b0e3/0x892c60dda91c9917 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.416034:0:24214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006fe1b0e3/0x892c60dda91c9917 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.416053:0:24214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1788528757.416362:0:24214:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00010000:00010000:0.0:1788528757.416599:0:22694:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528757.416607:0:22694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006fe1b0e3/0x892c60dda91c9917 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.416616:0:22694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3a000 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528757.416620:0:22694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006fe1b0e3/0x892c60dda91c9917 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.416629:0:22694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006fe1b0e3/0x892c60dda91c9917 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.416644:0:22694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006fe1b0e3/0x892c60dda91c9917 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.416652:0:22694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fe1b0e3/0x892c60dda91c9917 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.416680:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528757.416682:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528757.416684:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528757.416758:0:25104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788528757.416770:0:25104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23451:x1875407735616128:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788528757.416799:0:25104:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00010000:00010000:2.0:1788528757.417004:0:25102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528757.417007:0:25102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528757.417009:0:25102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528757.417227:0:25104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23451:x1875407735616128:12345-0@lo:5:osp-pre-1-1.0 Request processed in 458us (16209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528757.417234:0:25104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788528757.417282:0:23451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ace00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23451:1875407735616128:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788528757.417299:0:23451:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1788528757.417339:0:23451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe693480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23451:1875407735616256:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788528757.417367:0:23451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528757.417386:0:23451:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90d82ce480 going to sleep for 11 seconds 00000100:00100000:0.0:1788528757.417399:0:24212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735616256 00000100:00100000:0.0:1788528757.417403:0:24212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735616256 00000100:00100000:0.0:1788528757.417431:0:24212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788528757.417436:0:24212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23451:x1875407735616256:12345-0@lo:5:osp-pre-1-1.0 00000001:00080000:2.0:1788528757.417687:0:25028:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:2.0:1788528757.417722:0:25028:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788528757.417726:0:25028:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788528757.417926:0:24214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22730:x1875407735615616:12345-0@lo:5:osp-pre-0-0.0 Request processed in 100057us (101213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528757.417935:0:24214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00002000:00080000:0.0:1788528757.418007:0:24212:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00000100:00100000:3.0:1788528757.418693:0:22730:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22730:1875407735615616:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788528757.418706:0:22730:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:3.0:1788528757.418742:0:22730:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ae300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22730:1875407735616384:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788528757.418777:0:22730:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528757.418924:0:24214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735616384 00000100:00100000:0.0:1788528757.418929:0:24214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735616384 00000100:00100000:0.0:1788528757.418975:0:24214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788528757.418982:0:24214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22730:x1875407735616384:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788528757.419014:0:24214:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000100:00100000:3.0:1788528757.420574:0:22730:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90de607c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788528757.423975:0:24794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22732:x1875407735616000:12345-0@lo:5:osp-pre-1-0.0 Request processed in 23216us (34486us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788528757.423987:0:24794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788528757.424452:0:22732:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1788528757.424532:0:22732:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6bc9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22732:1875407735616000:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788528757.424549:0:22732:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00000001:00080000:2.0:1788528757.432696:0:24208:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:2.0:1788528757.432765:0:24208:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788528757.433095:0:24214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22730:x1875407735616384:12345-0@lo:5:osp-pre-0-0.0 Request processed in 14108us (14312us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1788528757.433105:0:24214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788528757.433126:0:22730:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1788528757.433135:0:22730:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ae300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22730:1875407735616384:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788528757.433151:0:22730:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00000100:00100000:0.0:1788528757.442060:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735616512:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788528757.442139:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528757.443637:0:24216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735616512 00000100:00100000:2.0:1788528757.443648:0:24216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735616512 00000100:00100000:2.0:1788528757.443700:0:24216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788528757.443709:0:24216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe692300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735616512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788528757.443733:0:24216:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528757.443813:0:24216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe692300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735616512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (1663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528757.443820:0:24216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788528757.443871:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735616512:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788528757.445355:0:24212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23451:x1875407735616256:12345-0@lo:5:osp-pre-1-1.0 Request processed in 27913us (27982us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1788528757.445367:0:24212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788528757.445403:0:23451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe693480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23451:1875407735616256:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788528757.445419:0:23451:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:1.0:1788528757.445459:0:23451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa6a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23451:1875407735616640:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1788528757.445496:0:23451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528757.445526:0:23451:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78f03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788528757.447428:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735616640 00000100:00100000:2.0:1788528757.447442:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735616640 00000100:00100000:2.0:1788528757.447503:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788528757.447514:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23451:x1875407735616640:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1788528757.447616:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23451:x1875407735616640:12345-0@lo:900:osp-pre-1-1.0 Request processed in 105us (2119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528757.447625:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788528757.447641:0:23451:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90ffa6a300 x1875407735616640/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788528773 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788528757.447657:0:23451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa6a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23451:1875407735616640:0@lo:900:osp-pre-1-1.0 10000000:01000000:2.0:1788528757.886883:0:22702:0:(mgc_request.c:714:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788528757.886892:0:22702:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-mdtir-ffff8a90f5ac8800 from 14 10000000:01000000:2.0:1788528757.886897:0:22702:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788528757.886958:0:22702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c68db600/0x892c60dda91c991e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.886970:0:22702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c68db600/0x892c60dda91c991e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.886981:0:22702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c68db600/0x892c60dda91c991e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528757.887021:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6bc9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735616768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788528757.887425:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528757.887542:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c2d79540 going to sleep for 11 seconds 00000100:00100000:1.0:1788528757.889407:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735616768 00000100:00100000:1.0:1788528757.889421:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735616768 00000100:00100000:0.0:1788528757.889894:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788528757.889906:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c4002c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+25:22702:x1875407735616768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788528757.889921:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528757.889949:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c0031800/0x892c60dda91c9925 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c991e expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.889978:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c0031800/0x892c60dda91c9925 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c991e expref: 26 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.889989:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c0031800/0x892c60dda91c9925 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c991e expref: 26 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.889999:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0031800, rc 0) 00000100:00100000:0.0:1788528757.890175:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c4002c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+26:22702:x1875407735616768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 271us (2751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528757.890182:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788528757.890277:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6bc9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735616768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788528757.890296:0:22702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c68db600/0x892c60dda91c991e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9925 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.890306:0:22702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c68db600/0x892c60dda91c991e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c9925 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528757.890446:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6bc9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735616896:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788528757.890576:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528757.890675:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c2d79540 going to sleep for 11 seconds 00000100:00100000:0.0:1788528757.890796:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735616896 00000100:00100000:0.0:1788528757.890809:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735616896 00000100:00100000:0.0:1788528757.890835:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788528757.890847:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c4001450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+26:22702:x1875407735616896:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788528757.890861:0:22698:0:(mgs_nids.c:920:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788528757.890876:0:22698:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788528757.890879:0:22698:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1788528757.890964:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c4001450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+26:22702:x1875407735616896:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 118us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528757.890971:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788528757.891198:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6bc9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735616896:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788528757.891256:0:22702:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788528757.891264:0:22702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c68db600/0x892c60dda91c991e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9925 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.891273:0:22702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c68db600/0x892c60dda91c991e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9925 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788528757.891284:0:22702:0:(mgc_request.c:714:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788528757.891286:0:22702:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-mdtir-ffff8a90ff704000 from 14 10000000:01000000:2.0:1788528757.891289:0:22702:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788528757.891308:0:22702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c68da000/0x892c60dda91c992c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.891336:0:22702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c68da000/0x892c60dda91c992c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.891344:0:22702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c68da000/0x892c60dda91c992c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528757.891358:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6bc9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735617024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788528757.891386:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528757.891406:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c2d79540 going to sleep for 11 seconds 00000100:00100000:0.0:1788528757.891517:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735617024 00000100:00100000:0.0:1788528757.891523:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735617024 00000100:00100000:0.0:1788528757.891617:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788528757.891624:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c4000c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+26:22702:x1875407735617024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788528757.891634:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528757.891646:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c0031600/0x892c60dda91c9933 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c992c expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.891881:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c0031600/0x892c60dda91c9933 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c992c expref: 27 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.891891:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c0031600/0x892c60dda91c9933 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c992c expref: 27 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528757.891899:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0031600, rc 0) 00000100:00100000:0.0:1788528757.891949:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c4000c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+27:22702:x1875407735617024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 325us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528757.891956:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788528757.892035:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6bc9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735617024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788528757.892047:0:22702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c68da000/0x892c60dda91c992c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9933 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.892055:0:22702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c68da000/0x892c60dda91c992c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c9933 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528757.892110:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6bc9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735617152:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788528757.892139:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528757.892330:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c2d79540 going to sleep for 11 seconds 00000100:00100000:1.0:1788528757.892424:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735617152 00000100:00100000:1.0:1788528757.892429:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735617152 00000100:00100000:1.0:1788528757.892453:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788528757.892460:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c4000850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+27:22702:x1875407735617152:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788528757.892473:0:22699:0:(mgs_nids.c:920:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788528757.892496:0:22699:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788528757.892500:0:22699:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1788528757.892592:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c4000850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+27:22702:x1875407735617152:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 133us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528757.892598:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788528757.892819:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6bc9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735617152:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788528757.892866:0:22702:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788528757.892874:0:22702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c68da000/0x892c60dda91c992c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9933 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528757.892882:0:22702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c68da000/0x892c60dda91c992c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9933 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528757.950713:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528758.462869:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788528758.462892:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735617280:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788528758.462974:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528758.463020:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735617280 00000100:00100000:1.0:1788528758.463028:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735617280 00000100:00100000:1.0:1788528758.463068:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788528758.463076:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735617280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788528758.463108:0:22710:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788528758.463154:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735617280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528758.463160:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788528758.463209:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735617280:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788528758.467814:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788528758.467837:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735617408:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788528758.467905:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528758.468143:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735617408 00000100:00100000:0.0:1788528758.468151:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735617408 00000100:00100000:0.0:1788528758.468205:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788528758.468214:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6bc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735617408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788528758.468259:0:22711:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788528758.468313:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6bc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735617408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528758.468320:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788528758.468398:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735617408:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788528758.979467:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788528759.615403:0:23462:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788528760.000193:0:25102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528761.023663:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528762.046779:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528762.562325:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735617920:0@lo:400:kworker.0 00000100:00100000:1.0:1788528762.562395:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528762.562456:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735618432:0@lo:400:kworker.0 00000100:00100000:1.0:1788528762.562481:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528762.562501:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735618944:0@lo:400:kworker.0 00000100:00100000:1.0:1788528762.562525:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528762.562567:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1788528762.562575:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07f6b94a-1259-41bf-8282-a67e1c8aef03:3638:1875407735617792:0@lo:400:kworker.0 00000100:00100000:1.0:1788528762.562604:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528762.562625:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875407735618304:0@lo:400:kworker.0 00000100:00100000:1.0:1788528762.562646:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528762.562662:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875407735618816:0@lo:400:kworker.0 00000100:00100000:1.0:1788528762.562696:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528762.562714:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1875407735619328:0@lo:400:kworker.0 00000100:00100000:1.0:1788528762.562738:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528762.562762:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735617920 00000100:00100000:1.0:1788528762.562769:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735617920 00000100:00100000:1.0:1788528762.562809:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735618432 00000100:00100000:1.0:1788528762.562813:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735618432 00000100:00100000:1.0:1788528762.562828:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788528762.562835:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735617920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528762.562885:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735617920:12345-0@lo:400:kworker.0 Request processed in 50us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528762.562892:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788528762.562919:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788528762.562926:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735618432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528762.562955:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735618432:12345-0@lo:400:kworker.0 Request processed in 30us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528762.562961:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788528762.562981:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735618944 00000100:00100000:1.0:1788528762.562985:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735618944 00000100:00100000:1.0:1788528762.563015:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735618304 00000100:00100000:1.0:1788528762.563018:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735618304 00000100:00100000:1.0:1788528762.563027:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735618816 00000100:00100000:1.0:1788528762.563029:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735618816 00000100:00100000:1.0:1788528762.563037:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735619328 00000100:00100000:1.0:1788528762.563039:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735619328 00000100:00100000:1.0:1788528762.563054:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788528762.563059:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875407735618944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528762.563088:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875407735618944:12345-0@lo:400:kworker.0 Request processed in 29us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528762.563100:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788528762.563113:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788528762.563118:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875407735618304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528762.563145:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875407735618304:12345-0@lo:400:kworker.0 Request processed in 27us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528762.563149:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788528762.563158:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788528762.563163:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875407735618816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528762.563186:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875407735618816:12345-0@lo:400:kworker.0 Request processed in 22us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528762.563191:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788528762.563202:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788528762.563207:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875407735619328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528762.563231:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875407735619328:12345-0@lo:400:kworker.0 Request processed in 25us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528762.563236:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788528762.563253:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735617792 00000100:00100000:1.0:1788528762.563256:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735617792 00000100:00100000:1.0:1788528762.563281:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788528762.563287:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c4003850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+27:3638:x1875407735617792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528762.563313:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c4003850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+27:3638:x1875407735617792:12345-0@lo:400:kworker.0 Request processed in 27us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528762.563318:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:1.0:1788528762.563351:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788528762.563355:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788528762.563388:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07f6b94a-1259-41bf-8282-a67e1c8aef03:3638:1875407735617792:0@lo:400:kworker.0 00010000:00080000:1.0:1788528762.563403:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90ffa68a80 x1875407735618304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528762.563414:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875407735618304:0@lo:400:kworker.0 00010000:00080000:1.0:1788528762.563423:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90ffa69500 x1875407735618816/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528762.563432:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875407735618816:0@lo:400:kworker.0 00010000:00080000:1.0:1788528762.563441:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90ffa6a300 x1875407735619328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528762.563449:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1875407735619328:0@lo:400:kworker.0 00000100:00100000:1.0:1788528762.563458:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735617920:0@lo:400:kworker.0 00000100:00100000:1.0:1788528762.563466:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735618432:0@lo:400:kworker.0 00010000:00080000:1.0:1788528762.563477:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90ffa6ad80 x1875407735618944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528762.563484:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735618944:0@lo:400:kworker.0 00000100:00100000:2.0:1788528762.566892:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fa8ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735617536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788528762.566971:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528762.567004:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735618048:0@lo:400:kworker.0 00000100:00100000:2.0:1788528762.567040:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528762.567064:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735618560:0@lo:400:kworker.0 00000100:00100000:2.0:1788528762.567086:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528762.567102:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1875407735619072:0@lo:400:kworker.0 00000100:00100000:2.0:1788528762.567123:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528762.567149:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1788528762.567156:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735617664:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788528762.567177:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528762.567193:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735618176:0@lo:400:kworker.0 00000100:00100000:2.0:1788528762.567209:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528762.567223:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735618688:0@lo:400:kworker.0 00000100:00100000:2.0:1788528762.567239:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528762.567254:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1875407735619200:0@lo:400:kworker.0 00000100:00100000:2.0:1788528762.567275:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528762.567312:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788528762.567319:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6bc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735619456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788528762.567349:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528762.567423:0:24795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735617536 00000100:00100000:2.0:1788528762.567431:0:24795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735617536 00000100:00100000:2.0:1788528762.567476:0:24795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735617664 00000100:00100000:2.0:1788528762.567480:0:24795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735617664 00000100:00100000:2.0:1788528762.567493:0:24795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735619456 00000100:00100000:2.0:1788528762.567495:0:24795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735619456 00000100:00100000:2.0:1788528762.567508:0:24795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788528762.567516:0:24795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6bc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735617536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788528762.567543:0:24795:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528762.567604:0:24795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6bc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735617536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528762.567611:0:24795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788528762.567626:0:24795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788528762.567632:0:24795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3ff1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3639:x1875407735617664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788528762.567657:0:24795:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915845632 avail 3684323328 00000100:00100000:2.0:1788528762.567684:0:24795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3ff1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3639:x1875407735617664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528762.567690:0:24795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788528762.567702:0:24795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788528762.567708:0:24795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735619456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788528762.567716:0:24795:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915845632 avail 3684323328 00000100:00100000:2.0:1788528762.567747:0:24795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735619456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528762.567752:0:24795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788528762.567770:0:24213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735618048 00000100:00100000:2.0:1788528762.567773:0:24213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735618048 00000100:00100000:2.0:1788528762.567802:0:24213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735618560 00000100:00100000:2.0:1788528762.567806:0:24213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735618560 00000100:00100000:2.0:1788528762.567817:0:24213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735618176 00000100:00100000:2.0:1788528762.567820:0:24213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735618176 00000100:00100000:2.0:1788528762.567827:0:24213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735618688 00000100:00100000:2.0:1788528762.567829:0:24213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735618688 00000100:00100000:2.0:1788528762.567841:0:24213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788528762.567846:0:24213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3ff2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735618048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528762.567879:0:24213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3ff2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735618048:12345-0@lo:400:kworker.0 Request processed in 32us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528762.567885:0:24213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788528762.567896:0:24213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788528762.567912:0:24213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735618560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528762.567939:0:24213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735618560:12345-0@lo:400:kworker.0 Request processed in 38us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528762.567944:0:24213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788528762.567954:0:24213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788528762.567960:0:24213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735618176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528762.568107:0:24213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735618176:12345-0@lo:400:kworker.0 Request processed in 147us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528762.568114:0:24213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788528762.568124:0:24213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788528762.568130:0:24213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3639:x1875407735618688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528762.568157:0:24213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3639:x1875407735618688:12345-0@lo:400:kworker.0 Request processed in 27us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528762.568162:0:24213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788528762.568217:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735617664:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788528762.568236:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735618176:0@lo:400:kworker.0 00000100:00100000:2.0:1788528762.568245:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735618688:0@lo:400:kworker.0 00000100:00100000:2.0:1788528762.568258:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fa8ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735617536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788528762.568265:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735618048:0@lo:400:kworker.0 00000100:00100000:2.0:1788528762.568273:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735618560:0@lo:400:kworker.0 00000100:00100000:2.0:1788528762.568310:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6bc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735619456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788528762.568502:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735619072 00000100:00100000:2.0:1788528762.568507:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735619072 00000100:00100000:2.0:1788528762.568537:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735619200 00000100:00100000:2.0:1788528762.568540:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735619200 00000100:00100000:2.0:1788528762.568576:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788528762.568583:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3ff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875407735619072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528762.568622:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3ff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875407735619072:12345-0@lo:400:kworker.0 Request processed in 39us (1497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528762.568628:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788528762.568640:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788528762.568646:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875407735619200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528762.568674:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875407735619200:12345-0@lo:400:kworker.0 Request processed in 28us (1399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528762.568679:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1788528762.568706:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90ffa69f80 x1875407735619200/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528762.568717:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1875407735619200:0@lo:400:kworker.0 00010000:00080000:2.0:1788528762.568737:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90ffa68e00 x1875407735619072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528762.568744:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1875407735619072:0@lo:400:kworker.0 00000100:00080000:2.0:1788528762.568768:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788528762.568772:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788528762.568775:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788528762.568777:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788528762.575608:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc37aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735619584:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788528762.575685:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528762.575811:0:24795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735619584 00000100:00100000:2.0:1788528762.575819:0:24795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735619584 00000100:00100000:2.0:1788528762.575862:0:24795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788528762.575871:0:24795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3ff1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735619584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788528762.575894:0:24795:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528762.578675:0:24795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3ff1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735619584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2798us (2982us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528762.578687:0:24795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788528762.578955:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc37aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735619584:0@lo:13:osp-pre-0-1.0 00000001:00080000:3.0:1788528762.585239:0:25028:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000001:02000400:1.0:1788528762.637402:0:25385:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788528763.074952:0:25102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528763.583178:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788528763.583207:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735619712:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788528763.583312:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528763.583389:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735619712 00000100:00100000:2.0:1788528763.583400:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735619712 00000100:00100000:2.0:1788528763.583472:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788528763.583484:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735619712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788528763.583529:0:23449:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788528763.583604:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735619712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528763.583611:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788528763.583663:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735619712:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788528763.584486:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788528763.584504:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90faa0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735619840:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788528763.584575:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528763.584675:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735619840 00000100:00100000:0.0:1788528763.584683:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735619840 00000100:00100000:0.0:1788528763.584720:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788528763.584727:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fa8ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735619840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788528763.584756:0:22710:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788528763.584821:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fa8ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735619840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528763.584829:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788528763.585063:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90faa0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735619840:0@lo:41:osp-pre-1-0.0 00000020:00000004:1.0:1788528763.812391:0:25437:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788528763.816818:0:25437:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788528764.094721:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788528764.657518:0:25487:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788528764.657957:0:25487:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1788528764.675231:0:22740:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788528764.871680:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528764.871902:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719777664 00000100:00100000:3.0:1788528764.871911:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719777664 00000100:00100000:3.0:1788528764.871962:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 122 00000100:00100000:3.0:1788528764.871969:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c4001c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2402:x1875407719777664:12345-192.168.203.38@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788528764.872063:0:22700:0:(ldlm_lib.c:1458:target_handle_connect()) MGS: connection from 225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60@192.168.203.38@tcp t0 exp 0000000000000000 cur 634 last 0 00000020:00000080:3.0:1788528764.872096:0:22700:0:(genops.c:1385:class_connect()) connect: client 225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60, cookie 0x892c60dda91c993a 00000100:00080000:3.0:1788528764.872290:0:22700:0:(import.c:65:import_set_state_nolock()) ffff8a8fc4fa5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788528764.872356:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c4001c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+5:2402:x1875407719777664:12345-192.168.203.38@tcp:250:mount.lustre.0 Request processed in 385us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528764.872364:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 122 00000100:00100000:3.0:1788528764.881970:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528764.882004:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719777792 00000100:00100000:3.0:1788528764.882014:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719777792 00000100:00100000:3.0:1788528764.882060:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 123 00000100:00100000:3.0:1788528764.882069:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c680b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+5:18061:x1875407719777792:12345-192.168.203.38@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788528764.882085:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528764.882104:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90f6f3a800/0x892c60dda91c9941 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c0233 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528764.882134:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90f6f3a800/0x892c60dda91c9941 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0233 expref: 6 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528764.882145:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90f6f3a800/0x892c60dda91c9941 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0233 expref: 6 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528764.882154:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3a800, rc 0) 00000100:00100000:3.0:1788528764.882216:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c680b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+6:18061:x1875407719777792:12345-192.168.203.38@tcp:101:mount.lustre.0 Request processed in 147us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528764.882223:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 123 00000100:00100000:3.0:1788528764.895898:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528764.896069:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719777920 00000100:00100000:2.0:1788528764.896078:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719777920 00000100:00100000:2.0:1788528764.896132:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 124 00000100:00100000:2.0:1788528764.896195:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c6809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+6:18061:x1875407719777920:12345-192.168.203.38@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788528764.896317:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c6809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+6:18061:x1875407719777920:12345-192.168.203.38@tcp:501:mount.lustre.0 Request processed in 124us (440us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788528764.896325:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 124 00000100:00100000:1.0:1788528764.899252:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528764.899325:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719778048 00000100:00100000:3.0:1788528764.899348:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719778048 00000100:00100000:3.0:1788528764.899405:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 125 00000100:00100000:3.0:1788528764.899414:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c6809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+6:18061:x1875407719778048:12345-192.168.203.38@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788528764.899504:0:22700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528764.899523:0:22700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90f6f3b000/0x892c60dda91c9948 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c023a expref: -99 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528764.899588:0:22700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90f6f3b000/0x892c60dda91c9948 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c023a expref: 7 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528764.899605:0:22700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90f6f3b000/0x892c60dda91c9948 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c023a expref: 7 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528764.899615:0:22700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3b000, rc 0) 00000100:00100000:2.0:1788528764.900136:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c6809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+7:18061:x1875407719778048:12345-192.168.203.38@tcp:101:mount.lustre.0 Request processed in 721us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528764.900145:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 125 00000100:00100000:0.0:1788528764.903731:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528764.903791:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719778176 00000100:00100000:3.0:1788528764.903801:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719778176 00000100:00100000:3.0:1788528764.903850:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 126 00000100:00100000:3.0:1788528764.903859:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c680ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+7:18061:x1875407719778176:12345-192.168.203.38@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788528764.904090:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c680ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+8:18061:x1875407719778176:12345-192.168.203.38@tcp:501:mount.lustre.0 Request processed in 230us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528764.904098:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 126 00000100:00100000:3.0:1788528764.913097:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528764.913166:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719778304 00000100:00100000:2.0:1788528764.913176:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719778304 00000100:00100000:2.0:1788528764.913227:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 127 00000100:00100000:2.0:1788528764.913236:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c6808850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+8:18061:x1875407719778304:12345-192.168.203.38@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788528764.913517:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c6808850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+8:18061:x1875407719778304:12345-192.168.203.38@tcp:503:mount.lustre.0 Request processed in 279us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528764.913525:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 127 00000100:00100000:1.0:1788528764.927257:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528764.927422:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719778432 00000100:00100000:2.0:1788528764.927434:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719778432 00000100:00100000:2.0:1788528764.927488:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 128 00000100:00100000:2.0:1788528764.927499:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+8:18080:x1875407719778432:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788528764.927701:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+8:18080:x1875407719778432:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 204us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528764.927733:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 128 00000100:00100000:1.0:1788528764.960662:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528764.960829:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719778560 00000100:00100000:2.0:1788528764.960839:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719778560 00000100:00100000:2.0:1788528764.960907:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 129 00000100:00100000:2.0:1788528764.960917:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+8:18080:x1875407719778560:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788528764.961328:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+8:18080:x1875407719778560:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 163us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528764.961338:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 129 00000100:00100000:2.0:1788528764.972308:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528764.972775:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719778688 00000100:00100000:1.0:1788528764.972800:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719778688 00000100:00100000:1.0:1788528764.972873:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 130 00000100:00100000:1.0:1788528764.972883:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+8:18080:x1875407719778688:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788528764.973058:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+8:18080:x1875407719778688:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 176us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528764.973067:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 130 00000100:00100000:1.0:1788528764.977388:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528764.977604:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719778816 00000100:00100000:2.0:1788528764.977614:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719778816 00000100:00100000:2.0:1788528764.977670:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 131 00000100:00100000:2.0:1788528764.977680:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+8:18061:x1875407719778816:12345-192.168.203.38@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788528764.977696:0:22700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528764.977715:0:22700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c68dba00/0x892c60dda91c994f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c026b expref: -99 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528764.977746:0:22700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c68dba00/0x892c60dda91c994f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c026b expref: 9 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528764.977757:0:22700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c68dba00/0x892c60dda91c994f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c026b expref: 9 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528764.977767:0:22700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c68dba00, rc 0) 00000100:00100000:2.0:1788528764.977820:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+9:18061:x1875407719778816:12345-192.168.203.38@tcp:101:mount.lustre.0 Request processed in 142us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528764.977842:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 131 00000100:00100000:2.0:1788528764.986531:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528764.986746:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719778944 00000100:00100000:1.0:1788528764.986755:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719778944 00000100:00100000:1.0:1788528764.986834:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 132 00000100:00100000:1.0:1788528764.986844:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+9:18061:x1875407719778944:12345-192.168.203.38@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788528764.986869:0:22699:0:(mgs_nids.c:920:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788528764.986904:0:22699:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788528764.986908:0:22699:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788528764.986911:0:22699:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788528764.986914:0:22699:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788528764.986916:0:22699:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1788528764.989533:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+9:18061:x1875407719778944:12345-192.168.203.38@tcp:256:mount.lustre.0 Request processed in 2680us (3000us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528764.989547:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 132 00000100:00100000:1.0:1788528764.993117:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528764.993200:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719779072 00000100:00100000:3.0:1788528764.993209:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719779072 00000100:00100000:3.0:1788528764.993295:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 133 00000100:00100000:3.0:1788528764.993305:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+9:18061:x1875407719779072:12345-192.168.203.38@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788528764.993323:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528764.993350:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90f6f3a400/0x892c60dda91c9956 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c0272 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528764.993389:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90f6f3a400/0x892c60dda91c9956 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0272 expref: 10 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528764.993400:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90f6f3a400/0x892c60dda91c9956 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0272 expref: 10 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528764.993409:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3a400, rc 0) 00000100:00100000:3.0:1788528764.993460:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+10:18061:x1875407719779072:12345-192.168.203.38@tcp:101:mount.lustre.0 Request processed in 157us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528764.993467:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 133 00000100:00100000:2.0:1788528765.000384:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528765.000452:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719779200 00000100:00100000:1.0:1788528765.000461:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719779200 00000100:00100000:1.0:1788528765.000511:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 134 00000100:00100000:1.0:1788528765.000518:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+10:18061:x1875407719779200:12345-192.168.203.38@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788528765.000682:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+10:18061:x1875407719779200:12345-192.168.203.38@tcp:501:mount.lustre.0 Request processed in 163us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528765.000703:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 134 00000100:00100000:1.0:1788528765.002586:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528765.002718:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719779328 00000100:00100000:3.0:1788528765.002727:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719779328 00000100:00100000:3.0:1788528765.002783:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 135 00000100:00100000:3.0:1788528765.002792:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+10:18061:x1875407719779328:12345-192.168.203.38@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788528765.002935:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+10:18061:x1875407719779328:12345-192.168.203.38@tcp:503:mount.lustre.0 Request processed in 143us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528765.002943:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 135 00000100:00100000:3.0:1788528765.006277:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528765.006595:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719779456 00000100:00100000:1.0:1788528765.006605:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719779456 00000100:00100000:1.0:1788528765.006663:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 136 00000100:00100000:1.0:1788528765.006673:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+10:18084:x1875407719779456:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788528765.006833:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+10:18084:x1875407719779456:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 160us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528765.006841:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 136 00000100:00100000:2.0:1788528765.010827:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528765.010926:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719779584 00000100:00100000:3.0:1788528765.010937:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719779584 00000100:00100000:3.0:1788528765.011008:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 137 00000100:00100000:3.0:1788528765.011025:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+10:18084:x1875407719779584:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788528765.011184:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+10:18084:x1875407719779584:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 160us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528765.011202:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 137 00000100:00100000:0.0:1788528765.029540:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528765.029871:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719779712 00000100:00100000:2.0:1788528765.029881:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719779712 00000100:00100000:2.0:1788528765.029941:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:2.0:1788528765.029949:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2402:x1875407719779712:12345-192.168.203.38@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788528765.029982:0:22705:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from 333a2baa-d5e5-441e-8b53-5d69075ed300@192.168.203.38@tcp t0 exp 0000000000000000 cur 634 last 0 00000020:00000080:2.0:1788528765.030048:0:22705:0:(genops.c:1385:class_connect()) connect: client 333a2baa-d5e5-441e-8b53-5d69075ed300, cookie 0x892c60dda91c995d 00000004:00100000:2.0:1788528765.030074:0:22705:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788528765.030279:0:22705:0:(import.c:65:import_set_state_nolock()) ffff8a8fc47e0000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788528765.030346:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+6:2402:x1875407719779712:12345-192.168.203.38@tcp:38:mount.lustre.0 Request processed in 395us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528765.030353:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:0.0:1788528765.032263:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528765.032503:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719779968 00000100:00100000:2.0:1788528765.032512:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719779968 00000100:00100000:2.0:1788528765.032549:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 8 00000100:00100000:2.0:1788528765.032573:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2402:x1875407719779968:12345-192.168.203.38@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788528765.032601:0:22706:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0001: connection from 333a2baa-d5e5-441e-8b53-5d69075ed300@192.168.203.38@tcp t0 exp 0000000000000000 cur 634 last 0 00000020:00000080:2.0:1788528765.032646:0:22706:0:(genops.c:1385:class_connect()) connect: client 333a2baa-d5e5-441e-8b53-5d69075ed300, cookie 0x892c60dda91c9964 00000004:00100000:2.0:1788528765.032668:0:22706:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788528765.032879:0:22706:0:(import.c:65:import_set_state_nolock()) ffff8a8fc300d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788528765.032947:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:333a2baa-d5e5-441e-8b53-5d69075ed300+6:2402:x1875407719779968:12345-192.168.203.38@tcp:38:mount.lustre.0 Request processed in 372us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528765.032971:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 8 00000100:00100000:0.0:1788528765.049337:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528765.049379:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528765.049413:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528765.049723:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719779840 00000100:00100000:3.0:1788528765.049734:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719779840 00000100:00100000:3.0:1788528765.049802:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719780224 00000100:00100000:3.0:1788528765.049806:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719780224 00000100:00100000:3.0:1788528765.049817:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719780096 00000100:00100000:3.0:1788528765.049819:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719780096 00000100:00100000:3.0:1788528765.049842:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:3.0:1788528765.049852:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+7:0:x1875407719779840:12345-192.168.203.38@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788528765.049898:0:22705:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788528765.049980:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+7:0:x1875407719779840:12345-192.168.203.38@tcp:41:mount.lustre.0 Request processed in 129us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528765.049987:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:3.0:1788528765.050027:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:3.0:1788528765.050034:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+6:18061:x1875407719780224:12345-192.168.203.38@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788528765.050045:0:22705:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788528765.050067:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+6:18061:x1875407719780224:12345-192.168.203.38@tcp:41:mount.lustre.0 Request processed in 35us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528765.050073:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:3.0:1788528765.050085:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 11 00000100:00100000:3.0:1788528765.050092:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+6:0:x1875407719780096:12345-192.168.203.38@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788528765.050107:0:22705:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788528765.050144:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+6:0:x1875407719780096:12345-192.168.203.38@tcp:41:mount.lustre.0 Request processed in 52us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528765.050150:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 11 00000100:00080000:0.0:1788528765.050582:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788528765.050595:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788528765.054680:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528765.054765:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719780352 00000100:00100000:3.0:1788528765.054775:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719780352 00000100:00100000:3.0:1788528765.054830:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12 00000100:00100000:3.0:1788528765.054840:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3ff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+6:18061:x1875407719780352:12345-192.168.203.38@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788528765.056421:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3ff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+6:18061:x1875407719780352:12345-192.168.203.38@tcp:40:mount.lustre.0 Request processed in 1573us (1740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528765.056433:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12 00000100:00100000:0.0:1788528765.061191:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528765.061233:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528765.061268:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528765.061357:0:25104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719780480 00000100:00100000:1.0:1788528765.061365:0:25104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719780480 00000100:00100000:1.0:1788528765.061405:0:25104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719780608 00000100:00100000:1.0:1788528765.061409:0:25104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719780608 00000100:00100000:1.0:1788528765.061426:0:25104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 16 00000100:00100000:1.0:1788528765.061433:0:25104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2402:x1875407719780480:12345-192.168.203.38@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788528765.061466:0:25104:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0000: connection from 333a2baa-d5e5-441e-8b53-5d69075ed300@192.168.203.38@tcp t0 exp 0000000000000000 cur 634 last 0 00000020:00000080:1.0:1788528765.061494:0:25104:0:(genops.c:1385:class_connect()) connect: client 333a2baa-d5e5-441e-8b53-5d69075ed300, cookie 0x892c60dda91c996b 00002000:00100000:1.0:1788528765.061506:0:25104:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 333a2baa-d5e5-441e-8b53-5d69075ed300/ffff8a90f69c7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788528765.061524:0:25104:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788528765.061713:0:25104:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788528765.061741:0:25104:0:(import.c:65:import_set_state_nolock()) ffff8a90f69c0000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788528765.061800:0:25104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:333a2baa-d5e5-441e-8b53-5d69075ed300+6:2402:x1875407719780480:12345-192.168.203.38@tcp:8:mount.lustre.0 Request processed in 366us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528765.061808:0:25104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 16 00000100:00100000:1.0:1788528765.061825:0:25104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 17 00000100:00100000:1.0:1788528765.061843:0:25104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2402:x1875407719780608:12345-192.168.203.38@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788528765.061859:0:25104:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0001: connection from 333a2baa-d5e5-441e-8b53-5d69075ed300@192.168.203.38@tcp t0 exp 0000000000000000 cur 634 last 0 00000020:00000080:1.0:1788528765.061874:0:25104:0:(genops.c:1385:class_connect()) connect: client 333a2baa-d5e5-441e-8b53-5d69075ed300, cookie 0x892c60dda91c9972 00002000:00100000:1.0:1788528765.061879:0:25104:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 333a2baa-d5e5-441e-8b53-5d69075ed300/ffff8a90f69c3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788528765.061907:0:25104:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788528765.062000:0:25104:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788528765.062014:0:25104:0:(import.c:65:import_set_state_nolock()) ffff8a90f69c4000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788528765.062038:0:25104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:333a2baa-d5e5-441e-8b53-5d69075ed300+6:2402:x1875407719780608:12345-192.168.203.38@tcp:8:mount.lustre.0 Request processed in 194us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528765.062045:0:25104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 17 00000100:00100000:2.0:1788528765.062208:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719780736 00000100:00100000:2.0:1788528765.062212:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719780736 00000100:00100000:2.0:1788528765.062254:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 3 00000100:00100000:2.0:1788528765.062261:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90faa0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:333a2baa-d5e5-441e-8b53-5d69075ed300+6:18061:x1875407719780736:12345-192.168.203.38@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788528765.062299:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90faa0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:333a2baa-d5e5-441e-8b53-5d69075ed300+6:18061:x1875407719780736:12345-192.168.203.38@tcp:900:mount.lustre.0 Request processed in 38us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528765.062305:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 3 00000100:00100000:0.0:1788528765.065285:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528765.065410:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719780864 00000100:00100000:3.0:1788528765.065420:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719780864 00000100:00100000:3.0:1788528765.065473:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:3.0:1788528765.065483:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+6:18061:x1875407719780864:12345-192.168.203.38@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788528765.069299:0:22708:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3704us 00000004:00200000:3.0:1788528765.098620:0:22708:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788528765.098750:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+6:18061:x1875407719780864:12345-192.168.203.38@tcp:33:mount.lustre.0 Request processed in 33263us (33468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528765.098761:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 0 00010000:00010000:1.0:1788528765.119109:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528765.326819:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528765.326941:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719780992 00000100:00100000:2.0:1788528765.326951:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719780992 00000100:00100000:2.0:1788528765.327182:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 13 00000100:00100000:2.0:1788528765.327192:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:333a2baa-d5e5-441e-8b53-5d69075ed300+6:18107:x1875407719780992:12345-192.168.203.38@tcp:101:mkdir.0 00010000:00010000:2.0:1788528765.327211:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528765.327236:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68da600/0x892c60dda91c9979 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c02a3 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528765.327296:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db000/0x892c60dda91c9980 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528765.327309:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db000/0x892c60dda91c9980 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528765.327324:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db000/0x892c60dda91c9980 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788528765.327387:0:22706:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788528765.327402:0:22706:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788528765.327436:0:22706:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db000/0x892c60dda91c9980 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528765.327461:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68da600/0x892c60dda91c9979 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c02a3 expref: 8 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528765.327478:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db000/0x892c60dda91c9980 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c02a3 expref: 7 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528765.327486:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a91021e1600) 00010000:00010000:2.0:1788528765.327489:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788528765.327492:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c68db000, rc 0) 00000100:00100000:2.0:1788528765.327622:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:333a2baa-d5e5-441e-8b53-5d69075ed300+7:18107:x1875407719780992:12345-192.168.203.38@tcp:101:mkdir.0 Request processed in 432us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528765.327629:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 13 00010000:00010000:0.0:1788528766.143796:0:25102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528767.166956:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528767.167131:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528767.167337:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719781120 00000100:00100000:3.0:1788528767.167351:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719781120 00000100:00100000:3.0:1788528767.167447:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 14 00000100:00100000:3.0:1788528767.167460:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc37aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+7:18159:x1875407719781120:12345-192.168.203.38@tcp:41:lfs.0 00000004:00000024:3.0:1788528767.167516:0:22705:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788528767.167675:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc37aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+7:18159:x1875407719781120:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 217us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528767.167684:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 14 00000100:00080000:0.0:1788528767.167770:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788528767.170120:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528767.170381:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719781248 00000100:00100000:2.0:1788528767.170398:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719781248 00000100:00100000:2.0:1788528767.170519:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 15 00000100:00100000:2.0:1788528767.170537:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:333a2baa-d5e5-441e-8b53-5d69075ed300+6:18159:x1875407719781248:12345-192.168.203.38@tcp:41:lfs.0 00000004:00000024:2.0:1788528767.170666:0:22706:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788528767.171625:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:333a2baa-d5e5-441e-8b53-5d69075ed300+6:18159:x1875407719781248:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 1084us (1517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528767.171639:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 15 00000100:00080000:0.0:1788528767.171903:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788528767.179276:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528767.179460:0:24215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719781376 00000100:00100000:0.0:1788528767.179474:0:24215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719781376 00000100:00100000:0.0:1788528767.179617:0:24215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:0.0:1788528767.179633:0:24215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3ff3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:333a2baa-d5e5-441e-8b53-5d69075ed300+6:18159:x1875407719781376:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:0.0:1788528767.179676:0:24215:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788528767.179798:0:24215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3ff3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:333a2baa-d5e5-441e-8b53-5d69075ed300+6:18159:x1875407719781376:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 170us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528767.179806:0:24215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00080000:2.0:1788528767.180578:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788528767.193381:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528767.194118:0:24795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719781504 00000100:00100000:2.0:1788528767.194132:0:24795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719781504 00000100:00100000:2.0:1788528767.194276:0:24795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:2.0:1788528767.194290:0:24795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:333a2baa-d5e5-441e-8b53-5d69075ed300+6:18159:x1875407719781504:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:2.0:1788528767.194340:0:24795:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915845632 avail 3684323328 00000100:00080000:0.0:1788528767.194653:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788528767.195313:0:24795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:333a2baa-d5e5-441e-8b53-5d69075ed300+6:18159:x1875407719781504:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 1021us (1945us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528767.195325:0:24795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:3.0:1788528767.496315:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528767.496621:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719781632 00000100:00100000:2.0:1788528767.496635:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719781632 00000100:00100000:2.0:1788528767.496717:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 138 00000100:00100000:2.0:1788528767.496730:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+10:18189:x1875407719781632:12345-192.168.203.38@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788528767.496754:0:22699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528767.496780:0:22699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c68da800/0x892c60dda91c9987 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c02aa expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528767.496821:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c68da800/0x892c60dda91c9987 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c02aa expref: 11 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528767.496835:0:22699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c68da800/0x892c60dda91c9987 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c02aa expref: 11 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528767.496845:0:22699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c68da800, rc 0) 00000100:00100000:2.0:1788528767.496932:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+11:18189:x1875407719781632:12345-192.168.203.38@tcp:101:mount.lustre.0 Request processed in 204us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528767.496940:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 138 00000100:00100000:3.0:1788528767.504720:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528767.505086:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719781760 00000100:00100000:1.0:1788528767.505099:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719781760 00000100:00100000:1.0:1788528767.505174:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 139 00000100:00100000:1.0:1788528767.505186:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+11:18189:x1875407719781760:12345-192.168.203.38@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788528767.505354:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+11:18189:x1875407719781760:12345-192.168.203.38@tcp:501:mount.lustre.0 Request processed in 169us (647us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788528767.505363:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 139 00000100:00100000:1.0:1788528767.514417:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528767.514611:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719781888 00000100:00100000:3.0:1788528767.514625:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719781888 00000100:00100000:3.0:1788528767.514699:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 140 00000100:00100000:3.0:1788528767.514710:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+11:18189:x1875407719781888:12345-192.168.203.38@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788528767.514732:0:22700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528767.514755:0:22700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90f6f3a200/0x892c60dda91c998e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c02b1 expref: -99 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528767.514793:0:22700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90f6f3a200/0x892c60dda91c998e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c02b1 expref: 12 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528767.514807:0:22700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90f6f3a200/0x892c60dda91c998e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c02b1 expref: 12 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528767.514817:0:22700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3a200, rc 0) 00000100:00100000:3.0:1788528767.514903:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+12:18189:x1875407719781888:12345-192.168.203.38@tcp:101:mount.lustre.0 Request processed in 195us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528767.514911:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 140 00000100:00100000:3.0:1788528767.520777:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528767.521979:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719782016 00000100:00100000:1.0:1788528767.521998:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719782016 00000100:00100000:1.0:1788528767.522082:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 141 00000100:00100000:1.0:1788528767.522093:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+12:18189:x1875407719782016:12345-192.168.203.38@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788528767.522415:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+12:18189:x1875407719782016:12345-192.168.203.38@tcp:501:mount.lustre.0 Request processed in 322us (1652us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528767.522426:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 141 00000100:00100000:0.0:1788528767.541811:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528767.542230:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719782144 00000100:00100000:2.0:1788528767.542245:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719782144 00000100:00100000:2.0:1788528767.542320:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 142 00000100:00100000:2.0:1788528767.542333:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+12:18189:x1875407719782144:12345-192.168.203.38@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788528767.542548:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+12:18189:x1875407719782144:12345-192.168.203.38@tcp:503:mount.lustre.0 Request processed in 216us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528767.542604:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 142 00000100:00100000:2.0:1788528767.547910:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528767.552933:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719782272 00000100:00100000:3.0:1788528767.552956:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719782272 00000100:00100000:3.0:1788528767.553118:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 143 00000100:00100000:3.0:1788528767.553132:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+12:18198:x1875407719782272:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788528767.553377:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+12:18198:x1875407719782272:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 247us (5481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528767.553385:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 143 00000100:00100000:3.0:1788528767.582600:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528767.582747:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719782400 00000100:00100000:1.0:1788528767.582762:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719782400 00000100:00100000:1.0:1788528767.582847:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 144 00000100:00100000:1.0:1788528767.582861:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+12:18198:x1875407719782400:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788528767.583091:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+12:18198:x1875407719782400:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 232us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528767.583101:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 144 00000100:00100000:0.0:1788528767.592812:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528767.593069:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719782528 00000100:00100000:3.0:1788528767.593082:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719782528 00000100:00100000:3.0:1788528767.593152:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 145 00000100:00100000:3.0:1788528767.593163:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+12:18198:x1875407719782528:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788528767.593374:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+12:18198:x1875407719782528:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 212us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528767.593383:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 145 00000100:00100000:3.0:1788528767.598012:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528767.598902:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719782656 00000100:00100000:2.0:1788528767.598918:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719782656 00000100:00100000:0.0:1788528767.599223:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 146 00000100:00100000:0.0:1788528767.599246:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+12:18189:x1875407719782656:12345-192.168.203.38@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788528767.599270:0:22699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528767.599296:0:22699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c0030200/0x892c60dda91c9995 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c02e2 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528767.599358:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c0030200/0x892c60dda91c9995 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c02e2 expref: 13 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528767.599371:0:22699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c0030200/0x892c60dda91c9995 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c02e2 expref: 13 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528767.599382:0:22699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0030200, rc 0) 00000100:00100000:0.0:1788528767.599467:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+13:18189:x1875407719782656:12345-192.168.203.38@tcp:101:mount.lustre.0 Request processed in 225us (1481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528767.599476:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 146 00000100:00100000:0.0:1788528767.610843:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528767.614077:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719782784 00000100:00100000:3.0:1788528767.614104:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719782784 00000100:00100000:2.0:1788528767.614482:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 147 00000100:00100000:2.0:1788528767.614497:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+13:18189:x1875407719782784:12345-192.168.203.38@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788528767.614534:0:22700:0:(mgs_nids.c:920:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788528767.614704:0:22700:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788528767.614709:0:22700:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788528767.614713:0:22700:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788528767.614717:0:22700:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788528767.614720:0:22700:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1788528767.620922:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+13:18189:x1875407719782784:12345-192.168.203.38@tcp:256:mount.lustre.0 Request processed in 6412us (10077us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528767.620942:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 147 00000100:00100000:3.0:1788528767.626540:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528767.626701:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719782912 00000100:00100000:0.0:1788528767.626714:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719782912 00000100:00100000:0.0:1788528767.626789:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 148 00000100:00100000:0.0:1788528767.626802:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+13:18189:x1875407719782912:12345-192.168.203.38@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788528767.626824:0:22699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528767.626848:0:22699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c0030800/0x892c60dda91c999c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c02e9 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528767.626901:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c0030800/0x892c60dda91c999c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c02e9 expref: 14 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528767.626915:0:22699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c0030800/0x892c60dda91c999c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c02e9 expref: 14 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528767.626926:0:22699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0030800, rc 0) 00000100:00100000:0.0:1788528767.627001:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+14:18189:x1875407719782912:12345-192.168.203.38@tcp:101:mount.lustre.0 Request processed in 201us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528767.627027:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 148 00000100:00100000:0.0:1788528767.633453:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528767.634514:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719783040 00000100:00100000:2.0:1788528767.634532:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719783040 00000100:00100000:2.0:1788528767.634638:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 149 00000100:00100000:2.0:1788528767.634652:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+14:18189:x1875407719783040:12345-192.168.203.38@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788528767.634942:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+14:18189:x1875407719783040:12345-192.168.203.38@tcp:501:mount.lustre.0 Request processed in 293us (2452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528767.634951:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 149 00000100:00100000:3.0:1788528767.637987:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528767.638941:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719783168 00000100:00100000:1.0:1788528767.638956:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719783168 00000100:00100000:1.0:1788528767.639137:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 150 00000100:00100000:1.0:1788528767.639150:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+14:18189:x1875407719783168:12345-192.168.203.38@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788528767.639393:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+14:18189:x1875407719783168:12345-192.168.203.38@tcp:503:mount.lustre.0 Request processed in 244us (1417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528767.639402:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 150 00000100:00100000:0.0:1788528767.652658:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528767.652849:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719783296 00000100:00100000:1.0:1788528767.652863:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719783296 00000100:00100000:1.0:1788528767.652956:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 151 00000100:00100000:1.0:1788528767.653048:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+14:18203:x1875407719783296:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788528767.653425:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+14:18203:x1875407719783296:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 378us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528767.653435:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 151 00000100:00100000:0.0:1788528767.682493:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735619968:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788528767.682614:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528767.682821:0:24216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735619968 00000100:00100000:1.0:1788528767.682832:0:24216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735619968 00000100:00100000:1.0:1788528767.682971:0:24216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788528767.682983:0:24216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735619968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788528767.683014:0:24216:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788528767.683096:0:24216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735619968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528767.683104:0:24216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788528767.683143:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788528767.684280:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735619968:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788528767.687461:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3ff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07f6b94a-1259-41bf-8282-a67e1c8aef03:3640:1875407735620096:0@lo:400:kworker.0 00000100:00100000:2.0:1788528767.687599:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528767.687652:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3ff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735620736:0@lo:400:kworker.0 00000100:00100000:2.0:1788528767.687683:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528767.687705:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90fe690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735621248:0@lo:400:kworker.0 00000100:00100000:2.0:1788528767.687735:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528767.687739:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735620480:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788528767.687759:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c78fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1875407735621760:0@lo:400:kworker.0 00000100:00100000:0.0:1788528767.687786:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528767.687794:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528767.687823:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3ff1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735620992:0@lo:400:kworker.0 00000100:00100000:2.0:1788528767.687836:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1788528767.687845:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735620224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788528767.687858:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528767.687891:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528767.687901:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c78fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1875407735621504:0@lo:400:kworker.0 00000100:00100000:2.0:1788528767.687917:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3ff0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735620608:0@lo:400:kworker.0 00000100:00100000:0.0:1788528767.687935:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528767.687947:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528767.687968:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735621120:0@lo:400:kworker.0 00000100:00100000:2.0:1788528767.687986:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528767.688002:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c78fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1875407735621632:0@lo:400:kworker.0 00000100:00100000:2.0:1788528767.688022:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528767.688048:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735620096 00000100:00100000:2.0:1788528767.688057:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735620096 00000100:00100000:2.0:1788528767.688110:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788528767.688120:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+27:3640:x1875407735620096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528767.688173:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+27:3640:x1875407735620096:12345-0@lo:400:kworker.0 Request processed in 53us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528767.688181:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788528767.688216:0:24212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735620736 00000100:00100000:2.0:1788528767.688219:0:24212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735620736 00000100:00100000:2.0:1788528767.688266:0:24212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735620608 00000100:00100000:2.0:1788528767.688269:0:24212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735620608 00000100:00100000:2.0:1788528767.688289:0:24212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735621120 00000100:00100000:2.0:1788528767.688292:0:24212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735621120 00000100:00100000:2.0:1788528767.688305:0:24212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788528767.688311:0:24212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c78fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735620736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528767.688342:0:24212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c78fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735620736:12345-0@lo:400:kworker.0 Request processed in 31us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528767.688349:0:24212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788528767.688360:0:24212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788528767.688365:0:24212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c78fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735620608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528767.688388:0:24212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c78fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735620608:12345-0@lo:400:kworker.0 Request processed in 24us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528767.688394:0:24212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788528767.688405:0:24212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788528767.688410:0:24212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c78ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735621120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528767.688432:0:24212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c78ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735621120:12345-0@lo:400:kworker.0 Request processed in 22us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528767.688438:0:24212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788528767.688478:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3ff0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735620608:0@lo:400:kworker.0 00000100:00100000:2.0:1788528767.688487:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1788528767.688505:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735621120:0@lo:400:kworker.0 00000100:00100000:2.0:1788528767.688513:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3ff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07f6b94a-1259-41bf-8282-a67e1c8aef03:3640:1875407735620096:0@lo:400:kworker.0 00000100:00100000:2.0:1788528767.688522:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3ff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735620736:0@lo:400:kworker.0 00000100:00100000:2.0:1788528767.688590:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735621248 00000100:00100000:2.0:1788528767.688600:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735621248 00000100:00100000:2.0:1788528767.688620:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735621760 00000100:00100000:2.0:1788528767.688622:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735621760 00000100:00100000:2.0:1788528767.688634:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735621504 00000100:00100000:2.0:1788528767.688636:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735621504 00000100:00100000:2.0:1788528767.688646:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735621632 00000100:00100000:2.0:1788528767.688648:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735621632 00000100:00100000:2.0:1788528767.688661:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788528767.688666:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c78ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735621248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528767.688702:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c78ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735621248:12345-0@lo:400:kworker.0 Request processed in 36us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528767.688708:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788528767.688721:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788528767.688726:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c78fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875407735621760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528767.688752:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c78fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875407735621760:12345-0@lo:400:kworker.0 Request processed in 27us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528767.688758:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788528767.688768:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788528767.688773:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875407735621504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528767.689524:0:22707:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788528767.689539:0:22707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:1.0:1788528767.689716:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788528767.689722:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788528767.689726:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788528767.689730:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788528767.689754:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3ff3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735620352:0@lo:400:kworker.0 00000100:00100000:1.0:1788528767.689820:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528767.689858:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3ff3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875407735620864:0@lo:400:kworker.0 00000100:00100000:1.0:1788528767.689896:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528767.689910:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6bc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1875407735621376:0@lo:400:kworker.0 00000100:00100000:3.0:1788528767.689940:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528767.689947:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528767.689964:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735621888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788528767.689975:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719783424 00000100:00100000:3.0:1788528767.689983:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719783424 00000100:00100000:1.0:1788528767.689990:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528767.690032:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735620992 00000100:00100000:3.0:1788528767.690036:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 153 00000100:00100000:1.0:1788528767.690039:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735620992 00000100:00100000:3.0:1788528767.690049:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+14:18203:x1875407719783424:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788528767.690075:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735620352 00000100:00100000:1.0:1788528767.690079:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735620352 00000100:00100000:1.0:1788528767.690093:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788528767.690109:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735620992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528767.690170:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735620992:12345-0@lo:400:kworker.0 Request processed in 62us (2312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528767.690178:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788528767.690200:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788528767.690206:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+14:18203:x1875407719783424:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 158us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528767.690213:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735620352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528767.690220:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 153 00000100:00100000:1.0:1788528767.690257:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735620352:12345-0@lo:400:kworker.0 Request processed in 47us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528767.690264:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788528767.690291:0:24215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735620480 00000100:00100000:1.0:1788528767.690295:0:24215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735620480 00000100:00100000:1.0:1788528767.690547:0:24215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735620224 00000100:00100000:1.0:1788528767.690578:0:24215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735620224 00000100:00100000:1.0:1788528767.690592:0:24215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735621888 00000100:00100000:1.0:1788528767.690594:0:24215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735621888 00000100:00100000:1.0:1788528767.690606:0:24215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788528767.690611:0:24215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735620480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788528767.690628:0:24215:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915845632 avail 3684323328 00000100:00100000:1.0:1788528767.690665:0:24215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735620480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (2880us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528767.690670:0:24215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788528767.690682:0:24215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788528767.690687:0:24215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c78ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735620224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788528767.690697:0:24215:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788528767.690729:0:24215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c78ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735620224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (2838us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528767.690734:0:24215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788528767.690753:0:24215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788528767.690759:0:24215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735621888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788528767.690769:0:24215:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915845632 avail 3684323328 00000100:00100000:1.0:1788528767.690795:0:24215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735621888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528767.690801:0:24215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788528767.690842:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3ff3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735620352:0@lo:400:kworker.0 00000100:00100000:1.0:1788528767.690863:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735621888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788528767.690951:0:22706:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788528767.690959:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735620864 00000100:00100000:1.0:1788528767.690961:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735620864 00000100:00100000:1.0:1788528767.690979:0:22706:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788528767.690984:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735621376 00000100:00100000:1.0:1788528767.690987:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735621376 00000100:00100000:1.0:1788528767.691011:0:22706:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788528767.691017:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788528767.691022:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c78ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875407735621632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528767.691058:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c78ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875407735621632:12345-0@lo:400:kworker.0 Request processed in 36us (3035us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528767.691071:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788528767.691084:0:22706:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788528767.691090:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788528767.691096:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875407735620864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528767.691130:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875407735620864:12345-0@lo:400:kworker.0 Request processed in 34us (1234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528767.691136:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788528767.691146:0:22706:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788528767.691159:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788528767.691167:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875407735621376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528767.691198:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875407735621376:12345-0@lo:400:kworker.0 Request processed in 33us (1254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528767.691204:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788528767.691243:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3ff3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875407735620864:0@lo:400:kworker.0 00000100:00100000:1.0:1788528767.691254:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6bc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1875407735621376:0@lo:400:kworker.0 00000100:00080000:3.0:1788528767.691411:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788528767.691600:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735620480:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788528767.691616:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3ff1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735620992:0@lo:400:kworker.0 00010000:00080000:0.0:1788528767.691659:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90c78fea00 x1875407735621504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528767.691661:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875407735621504:12345-0@lo:400:kworker.0 Request processed in 2884us (3724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528767.691678:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788528767.691682:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c78fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1875407735621504:0@lo:400:kworker.0 00000100:00100000:3.0:1788528767.691773:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735620224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788528767.691793:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c78fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1875407735621632:0@lo:400:kworker.0 00000100:00100000:3.0:1788528767.691811:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90fe690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735621248:0@lo:400:kworker.0 00010000:00080000:3.0:1788528767.691824:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90c78fd500 x1875407735621760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528767.691843:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c78fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1875407735621760:0@lo:400:kworker.0 00000100:00100000:0.0:1788528767.698644:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528767.701046:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719783552 00000100:00100000:1.0:1788528767.701065:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719783552 00000100:00100000:1.0:1788528767.701153:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 16 00000100:00100000:1.0:1788528767.701176:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2402:x1875407719783552:12345-192.168.203.38@tcp:38:mount.lustre.0 00000100:00100000:0.0:1788528767.701190:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00010000:00080000:1.0:1788528767.701220:0:22706:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from 86b97e15-e0df-43d0-a2df-10bdbaf02f48@192.168.203.38@tcp t0 exp 0000000000000000 cur 636 last 0 00000020:00000080:1.0:1788528767.701274:0:22706:0:(genops.c:1385:class_connect()) connect: client 86b97e15-e0df-43d0-a2df-10bdbaf02f48, cookie 0x892c60dda91c99a3 00000004:00100000:1.0:1788528767.701307:0:22706:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1788528767.701426:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719783808 00000100:00080000:1.0:1788528767.701430:0:22706:0:(import.c:65:import_set_state_nolock()) ffff8a90f69c5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788528767.701433:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719783808 00000100:00100000:2.0:1788528767.701485:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 17 00000100:00100000:2.0:1788528767.701492:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2402:x1875407719783808:12345-192.168.203.38@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788528767.701513:0:22705:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0001: connection from 86b97e15-e0df-43d0-a2df-10bdbaf02f48@192.168.203.38@tcp t0 exp 0000000000000000 cur 636 last 0 00000100:00100000:1.0:1788528767.701520:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86b97e15-e0df-43d0-a2df-10bdbaf02f48+6:2402:x1875407719783552:12345-192.168.203.38@tcp:38:mount.lustre.0 Request processed in 353us (2886us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528767.701529:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 16 00000020:00000080:2.0:1788528767.701588:0:22705:0:(genops.c:1385:class_connect()) connect: client 86b97e15-e0df-43d0-a2df-10bdbaf02f48, cookie 0x892c60dda91c99aa 00000004:00100000:2.0:1788528767.701605:0:22705:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788528767.701662:0:22705:0:(import.c:65:import_set_state_nolock()) ffff8a9101269800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788528767.701694:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86b97e15-e0df-43d0-a2df-10bdbaf02f48+6:2402:x1875407719783808:12345-192.168.203.38@tcp:38:mount.lustre.0 Request processed in 203us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528767.701702:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 17 00000100:00100000:3.0:1788528767.713798:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528767.713847:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528767.714028:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719783936 00000100:00100000:2.0:1788528767.714042:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719783936 00000100:00100000:2.0:1788528767.714138:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719783680 00000100:00100000:2.0:1788528767.714142:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719783680 00000100:00100000:2.0:1788528767.714171:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 18 00000100:00100000:2.0:1788528767.714184:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86b97e15-e0df-43d0-a2df-10bdbaf02f48+6:0:x1875407719783936:12345-192.168.203.38@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788528767.714437:0:22707:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788528767.714531:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86b97e15-e0df-43d0-a2df-10bdbaf02f48+6:0:x1875407719783936:12345-192.168.203.38@tcp:41:mount.lustre.0 Request processed in 349us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528767.714539:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 18 00000100:00100000:2.0:1788528767.714596:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00100000:2.0:1788528767.714603:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86b97e15-e0df-43d0-a2df-10bdbaf02f48+6:0:x1875407719783680:12345-192.168.203.38@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788528767.714619:0:22707:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788528767.714649:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86b97e15-e0df-43d0-a2df-10bdbaf02f48+6:0:x1875407719783680:12345-192.168.203.38@tcp:41:mount.lustre.0 Request processed in 47us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528767.714656:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00080000:3.0:1788528767.716823:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788528767.716835:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788528767.718431:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528767.718611:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719784064 00000100:00100000:2.0:1788528767.718625:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719784064 00000100:00100000:2.0:1788528767.718688:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 20 00000100:00100000:2.0:1788528767.718699:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86b97e15-e0df-43d0-a2df-10bdbaf02f48+6:18189:x1875407719784064:12345-192.168.203.38@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788528767.718826:0:22707:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788528767.718975:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86b97e15-e0df-43d0-a2df-10bdbaf02f48+6:18189:x1875407719784064:12345-192.168.203.38@tcp:41:mount.lustre.0 Request processed in 268us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528767.718984:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 20 00000100:00100000:0.0:1788528767.725930:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528767.726043:0:25501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719784192 00000100:00100000:3.0:1788528767.726066:0:25501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719784192 00000100:00100000:3.0:1788528767.726143:0:25501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 21 00000100:00100000:3.0:1788528767.726156:0:25501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86b97e15-e0df-43d0-a2df-10bdbaf02f48+6:18189:x1875407719784192:12345-192.168.203.38@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788528767.726290:0:25501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86b97e15-e0df-43d0-a2df-10bdbaf02f48+6:18189:x1875407719784192:12345-192.168.203.38@tcp:40:mount.lustre.0 Request processed in 136us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528767.726300:0:25501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 21 00000100:00100000:2.0:1788528767.738707:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528767.738789:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719784576 00000100:00100000:3.0:1788528767.738802:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719784576 00000100:00100000:3.0:1788528767.738892:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 4 00000100:00100000:2.0:1788528767.738897:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528767.738905:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c78fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:86b97e15-e0df-43d0-a2df-10bdbaf02f48+6:18189:x1875407719784576:12345-192.168.203.38@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788528767.739016:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c78fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:86b97e15-e0df-43d0-a2df-10bdbaf02f48+6:18189:x1875407719784576:12345-192.168.203.38@tcp:900:mount.lustre.0 Request processed in 112us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528767.739025:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 4 00000100:00100000:2.0:1788528767.739034:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528767.739168:0:24212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719784320 00000100:00100000:0.0:1788528767.739173:0:24212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719784320 00000100:00100000:0.0:1788528767.739204:0:24212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719784448 00000100:00100000:0.0:1788528767.739219:0:24212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719784448 00000100:00100000:0.0:1788528767.739243:0:24212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 18 00000100:00100000:0.0:1788528767.739249:0:24212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c78fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2402:x1875407719784320:12345-192.168.203.38@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788528767.739282:0:24212:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0000: connection from 86b97e15-e0df-43d0-a2df-10bdbaf02f48@192.168.203.38@tcp t0 exp 0000000000000000 cur 636 last 0 00000020:00000080:0.0:1788528767.739320:0:24212:0:(genops.c:1385:class_connect()) connect: client 86b97e15-e0df-43d0-a2df-10bdbaf02f48, cookie 0x892c60dda91c99b1 00000100:00100000:2.0:1788528767.739333:0:24214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 19 00002000:00100000:0.0:1788528767.739335:0:24212:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 86b97e15-e0df-43d0-a2df-10bdbaf02f48/ffff8a8fc45c6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:2.0:1788528767.739339:0:24214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c78fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2402:x1875407719784448:12345-192.168.203.38@tcp:8:mount.lustre.0 00002000:00100000:0.0:1788528767.739349:0:24212:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788528767.739434:0:24212:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00010000:00080000:2.0:1788528767.739445:0:24214:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0001: connection from 86b97e15-e0df-43d0-a2df-10bdbaf02f48@192.168.203.38@tcp t0 exp 0000000000000000 cur 636 last 0 00000020:00000080:2.0:1788528767.739465:0:24214:0:(genops.c:1385:class_connect()) connect: client 86b97e15-e0df-43d0-a2df-10bdbaf02f48, cookie 0x892c60dda91c99b8 00000100:00080000:0.0:1788528767.739468:0:24212:0:(import.c:65:import_set_state_nolock()) ffff8a8fc45c1800 : changing import state from RECOVER to FULL 00002000:00100000:2.0:1788528767.739470:0:24214:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 86b97e15-e0df-43d0-a2df-10bdbaf02f48/ffff8a910126a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788528767.739476:0:24214:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788528767.739513:0:24212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c78fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:86b97e15-e0df-43d0-a2df-10bdbaf02f48+6:2402:x1875407719784320:12345-192.168.203.38@tcp:8:mount.lustre.0 Request processed in 262us (615us total) trans 0 rc 0/0 00002000:00080000:2.0:1788528767.739520:0:24214:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:0.0:1788528767.739521:0:24212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 18 00000100:00080000:2.0:1788528767.739535:0:24214:0:(import.c:65:import_set_state_nolock()) ffff8a910126f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788528767.739587:0:24214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c78fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86b97e15-e0df-43d0-a2df-10bdbaf02f48+6:2402:x1875407719784448:12345-192.168.203.38@tcp:8:mount.lustre.0 Request processed in 247us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528767.739594:0:24214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00100000:2.0:1788528767.741936:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528767.742806:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719784704 00000100:00100000:0.0:1788528767.742822:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719784704 00000100:00100000:0.0:1788528767.742947:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1 00000100:00100000:0.0:1788528767.742960:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c78fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86b97e15-e0df-43d0-a2df-10bdbaf02f48+6:18189:x1875407719784704:12345-192.168.203.38@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788528767.743103:0:22709:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788528767.743213:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c78fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86b97e15-e0df-43d0-a2df-10bdbaf02f48+6:18189:x1875407719784704:12345-192.168.203.38@tcp:33:mount.lustre.0 Request processed in 256us (1288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528767.743221:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1 00000100:00100000:0.0:1788528767.902547:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528767.902710:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719784832 00000100:00100000:2.0:1788528767.902723:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719784832 00000100:00100000:2.0:1788528767.902822:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 22 00000100:00100000:2.0:1788528767.902834:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86b97e15-e0df-43d0-a2df-10bdbaf02f48+6:18226:x1875407719784832:12345-192.168.203.38@tcp:101:mkdir.0 00010000:00010000:2.0:1788528767.902860:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528767.902915:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dae00/0x892c60dda91c99bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c031a expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528767.903021:0:22707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dac00/0x892c60dda91c99c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528767.903038:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dac00/0x892c60dda91c99c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528767.903055:0:22707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dac00/0x892c60dda91c99c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788528767.903112:0:22707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788528767.903117:0:22707:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788528767.903143:0:22707:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dac00/0x892c60dda91c99c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528767.903174:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dae00/0x892c60dda91c99bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c031a expref: 8 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528767.903197:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dac00/0x892c60dda91c99c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c031a expref: 7 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528767.903206:0:22707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a91021e1600) 00010000:00010000:2.0:1788528767.903210:0:22707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788528767.903215:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c68dac00, rc 0) 00000100:00100000:2.0:1788528767.903297:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86b97e15-e0df-43d0-a2df-10bdbaf02f48+7:18226:x1875407719784832:12345-192.168.203.38@tcp:101:mkdir.0 Request processed in 464us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528767.903305:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 22 00010000:00010000:1.0:1788528768.194304:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528768.702995:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788528768.703027:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735622016:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788528768.703146:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528768.703319:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735622016 00000100:00100000:0.0:1788528768.703337:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735622016 00000100:00100000:0.0:1788528768.703408:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788528768.703420:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735622016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788528768.703467:0:22710:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788528768.703581:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735622016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 136us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528768.703589:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788528768.703854:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735622016:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788528768.704669:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788528768.704687:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735622144:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788528768.704745:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528768.704895:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735622144 00000100:00100000:0.0:1788528768.704903:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735622144 00000100:00100000:0.0:1788528768.704963:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788528768.704972:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735622144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788528768.705007:0:22711:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788528768.705060:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735622144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528768.705076:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788528768.705278:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735622144:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788528769.222925:0:25102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788528769.856238:0:23462:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788528770.238795:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788528770.756927:0:25028:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 86b97e15-e0df-43d0-a2df-10bdbaf02f48 00000001:00100000:2.0:1788528770.756940:0:25028:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 333a2baa-d5e5-441e-8b53-5d69075ed300 00000001:00100000:1.0:1788528770.757483:0:24208:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 86b97e15-e0df-43d0-a2df-10bdbaf02f48 00000001:00100000:1.0:1788528770.757491:0:24208:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 333a2baa-d5e5-441e-8b53-5d69075ed300 00000001:00100000:2.0:1788528770.757756:0:22685:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 86b97e15-e0df-43d0-a2df-10bdbaf02f48 00000001:00100000:2.0:1788528770.757762:0:22685:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 333a2baa-d5e5-441e-8b53-5d69075ed300 00000001:00100000:3.0:1788528770.758394:0:23439:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 86b97e15-e0df-43d0-a2df-10bdbaf02f48 00000001:00100000:3.0:1788528770.758401:0:23439:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 333a2baa-d5e5-441e-8b53-5d69075ed300 00000001:02000400:3.0:1788528770.826921:0:25586:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788528771.262872:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528772.292757:0:25102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528772.798771:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788528772.798797:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735622272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788528772.798875:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528772.802014:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788528772.802033:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c78fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735622400:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788528772.802090:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528772.805467:0:24215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735622272 00000100:00100000:1.0:1788528772.805477:0:24215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735622272 00000100:00100000:1.0:1788528772.805529:0:24215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735622400 00000100:00100000:1.0:1788528772.805532:0:24215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735622400 00000100:00100000:1.0:1788528772.805574:0:24215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788528772.805585:0:24215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c78fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735622272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788528772.805613:0:24215:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915845632 avail 3684323328 00000100:00100000:1.0:1788528772.805696:0:24215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c78fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735622272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (6819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528772.805704:0:24215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788528772.805725:0:24215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788528772.805733:0:24215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c78fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735622400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788528772.805744:0:24215:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915845632 avail 3684323328 00000100:00100000:2.0:1788528772.805748:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735622272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788528772.805778:0:24215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c78fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735622400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (3686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528772.805785:0:24215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788528772.805878:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788528772.805891:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735622656:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788528772.805925:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528772.805954:0:24215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735622656 00000100:00100000:1.0:1788528772.805957:0:24215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735622656 00000100:00100000:1.0:1788528772.805981:0:24215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788528772.805988:0:24215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735622656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788528772.806005:0:24215:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788528772.806037:0:24215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735622656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528772.806056:0:24215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788528772.807538:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735622656:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788528772.807952:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735622912:0@lo:400:kworker.0 00000100:00100000:3.0:1788528772.808003:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528772.808039:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875407735623424:0@lo:400:kworker.0 00000100:00080000:2.0:1788528772.808052:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788528772.808059:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788528772.808063:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528772.808087:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735622528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788528772.808088:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4677480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1875407735623936:0@lo:400:kworker.0 00000100:00100000:3.0:1788528772.808105:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528772.808155:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528772.808171:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528772.808189:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528772.808203:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528772.808216:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528772.808231:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528772.808241:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528772.808254:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528772.808266:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528772.808284:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735622912 00000100:00100000:3.0:1788528772.808289:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735622912 00000100:00100000:3.0:1788528772.808323:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788528772.808329:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735622912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528772.808368:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875407735622912:12345-0@lo:400:kworker.0 Request processed in 39us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528772.808375:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788528772.808401:0:25501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735623424 00000100:00100000:3.0:1788528772.808404:0:25501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735623424 00000100:00100000:3.0:1788528772.808419:0:25501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735623936 00000100:00100000:3.0:1788528772.808420:0:25501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735623936 00000100:00100000:3.0:1788528772.808435:0:25501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719785216 00000100:00100000:3.0:1788528772.808437:0:25501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719785216 00000100:00100000:3.0:1788528772.808447:0:25501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719785728 00000100:00100000:3.0:1788528772.808449:0:25501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719785728 00000100:00100000:3.0:1788528772.808457:0:25501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719785088 00000100:00100000:3.0:1788528772.808459:0:25501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719785088 00000100:00100000:3.0:1788528772.808466:0:25501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719785600 00000100:00100000:3.0:1788528772.808468:0:25501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719785600 00000100:00100000:3.0:1788528772.808479:0:25501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788528772.808483:0:25501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875407735623424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528772.808510:0:25501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875407735623424:12345-0@lo:400:kworker.0 Request processed in 26us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528772.808515:0:25501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788528772.808524:0:25501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788528772.808529:0:25501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875407735623936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528772.808547:0:25501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875407735623936:12345-0@lo:400:kworker.0 Request processed in 19us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528772.808572:0:25501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788528772.808582:0:25501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 41 00000100:00100000:3.0:1788528772.808588:0:25501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:333a2baa-d5e5-441e-8b53-5d69075ed300+5:2403:x1875407719785216:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528772.808623:0:25501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:333a2baa-d5e5-441e-8b53-5d69075ed300+5:2403:x1875407719785216:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 35us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528772.808629:0:25501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 41 00000100:00100000:3.0:1788528772.808638:0:25501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 42 00000100:00100000:3.0:1788528772.808649:0:25501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86b97e15-e0df-43d0-a2df-10bdbaf02f48+5:2403:x1875407719785728:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528772.808669:0:25501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86b97e15-e0df-43d0-a2df-10bdbaf02f48+5:2403:x1875407719785728:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 21us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528772.808674:0:25501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 42 00000100:00100000:3.0:1788528772.808683:0:25501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 43 00000100:00100000:3.0:1788528772.808688:0:25501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:333a2baa-d5e5-441e-8b53-5d69075ed300+6:2403:x1875407719785088:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528772.808704:0:25501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:333a2baa-d5e5-441e-8b53-5d69075ed300+6:2403:x1875407719785088:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 16us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528772.808709:0:25501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 43 00000100:00100000:3.0:1788528772.808717:0:25501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 44 00000100:00100000:3.0:1788528772.808722:0:25501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86b97e15-e0df-43d0-a2df-10bdbaf02f48+6:2403:x1875407719785600:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528772.808737:0:25501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86b97e15-e0df-43d0-a2df-10bdbaf02f48+6:2403:x1875407719785600:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 15us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528772.808742:0:25501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 44 00000100:00100000:3.0:1788528772.808759:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719784960 00000100:00100000:3.0:1788528772.808762:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719784960 00000100:00100000:3.0:1788528772.808783:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 154 00000100:00100000:3.0:1788528772.808788:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+14:2403:x1875407719784960:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528772.808806:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+14:2403:x1875407719784960:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 19us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528772.808812:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 154 00000100:00100000:3.0:1788528772.808851:0:24212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719785472 00000100:00100000:3.0:1788528772.808854:0:24212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719785472 00000100:00100000:3.0:1788528772.808875:0:24212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719785984 00000100:00100000:3.0:1788528772.808882:0:24212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719785984 00000100:00100000:3.0:1788528772.808893:0:24212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719785344 00000100:00100000:3.0:1788528772.808895:0:24212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719785344 00000100:00100000:3.0:1788528772.808904:0:24212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719785856 00000100:00100000:3.0:1788528772.808906:0:24212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719785856 00000100:00100000:3.0:1788528772.808918:0:24212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:3.0:1788528772.808923:0:24212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+5:2403:x1875407719785472:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528772.808945:0:24212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+5:2403:x1875407719785472:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 22us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528772.808951:0:24212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:3.0:1788528772.808960:0:24212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:3.0:1788528772.808965:0:24212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:86b97e15-e0df-43d0-a2df-10bdbaf02f48+5:2403:x1875407719785984:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528772.808980:0:24212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:86b97e15-e0df-43d0-a2df-10bdbaf02f48+5:2403:x1875407719785984:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 16us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528772.808986:0:24212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:3.0:1788528772.808995:0:24212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 11 00000100:00100000:3.0:1788528772.809000:0:24212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+5:2403:x1875407719785344:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528772.809019:0:24212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+5:2403:x1875407719785344:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 18us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528772.809026:0:24212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 11 00000100:00100000:3.0:1788528772.809036:0:24212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12 00000100:00100000:3.0:1788528772.809042:0:24212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:86b97e15-e0df-43d0-a2df-10bdbaf02f48+5:2403:x1875407719785856:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528772.809049:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528772.809064:0:24212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:86b97e15-e0df-43d0-a2df-10bdbaf02f48+5:2403:x1875407719785856:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 22us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528772.809071:0:24212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12 00000100:00100000:2.0:1788528772.809096:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735623040:0@lo:400:kworker.0 00000100:00100000:3.0:1788528772.809113:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1875407735622912:0@lo:400:kworker.0 00000100:00100000:3.0:1788528772.809125:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875407735623424:0@lo:400:kworker.0 00000100:00100000:2.0:1788528772.809131:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788528772.809142:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc4677480 x1875407735623936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528772.809152:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4677480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1875407735623936:0@lo:400:kworker.0 00000100:00100000:2.0:1788528772.809154:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6bc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735623552:0@lo:400:kworker.0 00000100:00080000:3.0:1788528772.809177:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788528772.809181:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788528772.809185:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788528772.809186:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788528772.809188:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788528772.809295:0:24213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735623040 00000100:00100000:3.0:1788528772.809298:0:24213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735623040 00000100:00100000:3.0:1788528772.809319:0:24213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788528772.809324:0:24213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c78fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735623040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528772.809349:0:24213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c78fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735623040:12345-0@lo:400:kworker.0 Request processed in 25us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528772.809354:0:24213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788528772.809367:0:25501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735623552 00000100:00100000:3.0:1788528772.809370:0:25501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735623552 00000100:00100000:3.0:1788528772.809386:0:25501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788528772.809390:0:25501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c78fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875407735623552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528772.809412:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c78fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735622400:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788528772.809414:0:25501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c78fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875407735623552:12345-0@lo:400:kworker.0 Request processed in 22us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528772.809424:0:25501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1788528772.809437:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788528772.809441:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788528772.809450:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735623040:0@lo:400:kworker.0 00000100:00100000:2.0:1788528772.809462:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6bc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735623552:0@lo:400:kworker.0 00000100:00100000:1.0:1788528772.809602:0:24795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735622528 00000100:00100000:1.0:1788528772.809607:0:24795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735622528 00000100:00100000:1.0:1788528772.809682:0:24795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788528772.809689:0:24795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c78fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735622528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788528772.809701:0:24795:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788528772.809742:0:24795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c78fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735622528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528772.809748:0:24795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788528772.809878:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07f6b94a-1259-41bf-8282-a67e1c8aef03:3640:1875407735622784:0@lo:400:kworker.0 00000100:00100000:1.0:1788528772.809908:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528772.809978:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735623296:0@lo:400:kworker.0 00000100:00100000:1.0:1788528772.810003:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528772.810020:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4675500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1875407735623808:0@lo:400:kworker.0 00000100:00100000:1.0:1788528772.810045:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528772.810061:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788528772.810067:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875407735623168:0@lo:400:kworker.0 00000100:00100000:1.0:1788528772.810099:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528772.810113:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc4674e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1875407735623680:0@lo:400:kworker.0 00000100:00100000:1.0:1788528772.810132:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528772.810154:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735623296 00000100:00100000:1.0:1788528772.810158:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735623296 00000100:00100000:1.0:1788528772.810181:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788528772.810188:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4674a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735623296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528772.810403:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4674a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735623296:12345-0@lo:400:kworker.0 Request processed in 215us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528772.810410:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788528772.810434:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735623296:0@lo:400:kworker.0 00000100:00100000:2.0:1788528772.810724:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735622784 00000100:00100000:2.0:1788528772.810729:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735622784 00000100:00100000:2.0:1788528772.810798:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788528772.810804:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5893050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+27:3640:x1875407735622784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788528772.810847:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5893050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+27:3640:x1875407735622784:12345-0@lo:400:kworker.0 Request processed in 44us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528772.810853:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788528772.810900:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07f6b94a-1259-41bf-8282-a67e1c8aef03:3640:1875407735622784:0@lo:400:kworker.0 00000100:00100000:3.0:1788528772.812137:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735623808 00000100:00100000:3.0:1788528772.812145:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735623808 00000100:00080000:2.0:1788528772.812282:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788528772.812319:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735623168 00000100:00100000:3.0:1788528772.812323:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735623168 00000100:00100000:1.0:1788528772.812497:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735623680 00000100:00100000:1.0:1788528772.812501:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735623680 00000100:00100000:1.0:1788528772.812527:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788528772.812533:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4675c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875407735623808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528772.812615:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4675c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875407735623808:12345-0@lo:400:kworker.0 Request processed in 82us (2569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528772.812622:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788528772.812635:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788528772.812641:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4676300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875407735623168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528772.812667:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4676300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875407735623168:12345-0@lo:400:kworker.0 Request processed in 26us (2568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528772.812672:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788528772.812681:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788528772.812687:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4677480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875407735623680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528772.812723:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4677480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875407735623680:12345-0@lo:400:kworker.0 Request processed in 36us (2589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528772.812728:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788528772.812761:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875407735623168:0@lo:400:kworker.0 00010000:00080000:1.0:1788528772.812774:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a8fc4674e00 x1875407735623680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788528772.812791:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4674e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1875407735623680:0@lo:400:kworker.0 00000100:00100000:1.0:1788528772.812802:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc4675500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1875407735623808:0@lo:400:kworker.0 00000100:00080000:2.0:1788528772.812920:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788528772.813107:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735622528:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788528773.311325:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528773.829746:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735624064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788528773.829817:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528773.835019:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735624064 00000100:00100000:0.0:1788528773.835033:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735624064 00000100:00100000:0.0:1788528773.835103:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788528773.835113:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4675500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735624064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788528773.835149:0:22711:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788528773.835518:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735624192:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788528773.835590:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528773.835694:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735624192 00000100:00100000:3.0:1788528773.835699:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735624192 00000100:00100000:3.0:1788528773.835731:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788528773.835738:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc4674e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735624192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788528773.835759:0:23449:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788528773.835800:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4674e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735624192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528773.835807:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788528773.835864:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735624192:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788528773.836193:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc4675500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735624064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1080us (6375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528773.836200:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788528773.840875:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735624064:0@lo:41:osp-pre-0-1.0 00000020:00000080:1.0:1788528774.251412:0:25733:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd9d3b7660 20000000:00000080:1.0:1788528774.251432:0:25733:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a9101252c00 uarg=0000000000000000 20000000:01000000:1.0:1788528774.251493:0:25733:0:(mgs_llog.c:6198:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788528774.251499:0:25733:0:(mgs_llog.c:4653:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788528774.251503:0:25733:0:(mgs_llog.c:1385:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788528774.252159:0:25734:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1788528774.252301:0:25733:0:(mgs_llog.c:1456:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788528774.264080:0:25733:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788528774.269661:0:25733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a90f6f3be00/0x892c60dda91c99cd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528774.269687:0:25733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9101850c00/0x892c60dda91c9607 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c9600 expref: 26 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528774.269696:0:25733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c9615 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c960e expref: 26 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528774.269702:0:25733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9101850800/0x892c60dda91c9662 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c965b expref: 26 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528774.269709:0:25733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a90c784fa00/0x892c60dda91c970a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c9703 expref: 26 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528774.269719:0:25733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a90f6f3a400/0x892c60dda91c9956 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0272 expref: 13 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528774.269742:0:25733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a90c0030800/0x892c60dda91c999c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c02e9 expref: 13 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528774.269750:0:25733:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a90f6f3be00/0x892c60dda91c99cd lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528774.269803:0:25733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a90c0030800/0x892c60dda91c999c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c02e9 expref: 13 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528774.269817:0:25733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a90c0030800/0x892c60dda91c999c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c02e9 expref: 13 pid: 22699 timeout: 743 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528774.269840:0:25733:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3e55880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25733:1875407735624320:192.168.203.38@tcp:104: 00010000:00010000:3.0:1788528774.269937:0:25733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a90f6f3a400/0x892c60dda91c9956 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0272 expref: 13 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528774.270367:0:25733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a90f6f3a400/0x892c60dda91c9956 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0272 expref: 13 pid: 22698 timeout: 743 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528774.270378:0:25733:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3e57b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25733:1875407735624448:192.168.203.38@tcp:104: 00010000:00010000:3.0:1788528774.270432:0:25733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a90c784fa00/0x892c60dda91c970a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c9703 expref: 26 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528774.270441:0:25733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a90c784fa00/0x892c60dda91c970a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c9703 expref: 26 pid: 22698 timeout: 743 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528774.270450:0:25733:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3e55c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25733:1875407735624576:0@lo:104: 00000100:00100000:3.0:1788528774.270484:0:25733:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788528774.270533:0:25733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9101850800/0x892c60dda91c9662 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c965b expref: 26 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528774.270543:0:25733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a9101850800/0x892c60dda91c9662 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c965b expref: 26 pid: 22698 timeout: 743 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528774.270550:0:25733:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3e55180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25733:1875407735624704:0@lo:104: 00000100:00100000:3.0:1788528774.270596:0:25733:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528774.270627:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735624576 00000100:00100000:3.0:1788528774.270633:0:22689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735624576 00000100:00100000:3.0:1788528774.270675:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735624704 00000100:00100000:3.0:1788528774.270678:0:22689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735624704 00000100:00100000:3.0:1788528774.270693:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788528774.270702:0:22689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07f6b94a-1259-41bf-8282-a67e1c8aef03+4:25733:x1875407735624576:12345-0@lo:104: 00010000:00010000:3.0:1788528774.270715:0:22689:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3600/0x892c60dda91c9703 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c970a expref: -99 pid: 25027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528774.270859:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788528774.270870:0:24236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa6a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:07f6b94a-1259-41bf-8282-a67e1c8aef03+4:25733:x1875407735624704:12345-0@lo:104: 00010000:00010000:2.0:1788528774.270878:0:24236:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a90c784f400/0x892c60dda91c965b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c9662 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528774.270926:0:22689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788528774.270933:0:22689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07f6b94a-1259-41bf-8282-a67e1c8aef03+4:25733:x1875407735624576:12345-0@lo:104: Request processed in 232us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528774.270940:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1788528774.270991:0:25733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c9615 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c960e expref: 26 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528774.271000:0:25733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c9615 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c960e expref: 26 pid: 22698 timeout: 743 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528774.271009:0:25733:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa6b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25733:1875407735624832:0@lo:104: 00000100:00100000:3.0:1788528774.271035:0:25733:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528774.271054:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735624832 00000100:00100000:3.0:1788528774.271064:0:22689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735624832 00000100:00100000:3.0:1788528774.271087:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788528774.271093:0:22689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07f6b94a-1259-41bf-8282-a67e1c8aef03+4:25733:x1875407735624832:12345-0@lo:104: 00010000:00010000:3.0:1788528774.271101:0:22689:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c960e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c9615 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528774.278136:0:24236:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788528774.278156:0:24236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa6a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:07f6b94a-1259-41bf-8282-a67e1c8aef03+4:25733:x1875407735624704:12345-0@lo:104: Request processed in 7283us (7553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528774.278168:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1788528774.278517:0:25733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9101850c00/0x892c60dda91c9607 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x892c60dda91c9600 expref: 26 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528774.278531:0:25733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a9101850c00/0x892c60dda91c9607 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x892c60dda91c9600 expref: 26 pid: 22699 timeout: 743 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528774.278544:0:25733:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90c78fd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25733:1875407735624960:0@lo:104: 00000100:00100000:2.0:1788528774.278617:0:25733:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528774.278645:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735624960 00000100:00100000:2.0:1788528774.278651:0:24236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735624960 00000100:00100000:2.0:1788528774.278692:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788528774.278699:0:24236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c78fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:07f6b94a-1259-41bf-8282-a67e1c8aef03+4:25733:x1875407735624960:12345-0@lo:104: 00010000:00010000:2.0:1788528774.278710:0:24236:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2e00/0x892c60dda91c9600 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c9607 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528774.278752:0:24236:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788528774.278756:0:24236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c78fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:07f6b94a-1259-41bf-8282-a67e1c8aef03+4:25733:x1875407735624960:12345-0@lo:104: Request processed in 59us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528774.278762:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788528774.278792:0:25733:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c2d793c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788528774.278814:0:25733:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3e55c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25733:1875407735624576:0@lo:104: 00000100:00100000:2.0:1788528774.278832:0:25733:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3e55180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25733:1875407735624704:0@lo:104: 00000100:00100000:2.0:1788528774.278841:0:25733:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa6b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25733:1875407735624832:0@lo:104: 00000100:00100000:2.0:1788528774.278849:0:25733:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90c78fd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25733:1875407735624960:0@lo:104: 00010000:00010000:0.0:1788528774.279135:0:25102:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788528774.279143:0:25102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3600/0x892c60dda91c9703 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c970a expref: -99 pid: 25027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528774.279151:0:25102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc26e3600 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:0.0:1788528774.279155:0:25102:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3600/0x892c60dda91c9703 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c970a expref: -99 pid: 25027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528774.279170:0:25102:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3600/0x892c60dda91c9703 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c970a expref: -99 pid: 25027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788528774.279178:0:25102:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3600/0x892c60dda91c9703 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c970a expref: -99 pid: 25027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528774.279183:0:25102:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788528774.279223:0:25102:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3600/0x892c60dda91c9703 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c970a expref: -99 pid: 25027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528774.279231:0:25102:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788528774.279252:0:25102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3600/0x892c60dda91c9703 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c970a expref: -99 pid: 25027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528774.279260:0:25102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e3600/0x892c60dda91c9703 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c970a expref: -99 pid: 25027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528774.279274:0:25102:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788528774.279277:0:25102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a90c784f400/0x892c60dda91c965b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c9662 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528774.279283:0:25102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c784f400 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:0.0:1788528774.279286:0:25102:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a90c784f400/0x892c60dda91c965b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c9662 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528774.279294:0:25102:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a90c784f400/0x892c60dda91c965b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c9662 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788528774.279300:0:25102:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a90c784f400/0x892c60dda91c965b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c9662 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528774.279312:0:25102:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788528774.279329:0:25102:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a90c784f400/0x892c60dda91c965b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c9662 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528774.279336:0:25102:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788528774.279350:0:25102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a90c784f400/0x892c60dda91c965b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c9662 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528774.279356:0:25102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a90c784f400/0x892c60dda91c965b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c9662 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528774.279365:0:25102:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788528774.279368:0:25102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c960e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c9615 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528774.279373:0:25102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9101851a00 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:0.0:1788528774.279376:0:25102:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c960e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c9615 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528774.279382:0:25102:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c960e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c9615 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788528774.279388:0:25102:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c960e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c9615 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528774.279393:0:25102:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788528774.279404:0:25102:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c960e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c9615 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528774.279409:0:25102:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788528774.279419:0:25102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c960e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c9615 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528774.279426:0:25102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a9101851a00/0x892c60dda91c960e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c9615 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528774.279434:0:25102:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528774.279437:0:25102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2e00/0x892c60dda91c9600 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x892c60dda91c9607 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528774.279442:0:25102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a8fc26e2e00 already unused, calling callback (ffffffffc11e0e00) 10000000:00010000:0.0:1788528774.279445:0:25102:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2e00/0x892c60dda91c9600 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x892c60dda91c9607 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528774.279452:0:25102:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2e00/0x892c60dda91c9600 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x892c60dda91c9607 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788528774.279457:0:25102:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2e00/0x892c60dda91c9600 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x892c60dda91c9607 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528774.279462:0:25102:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788528774.279474:0:25102:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2e00/0x892c60dda91c9600 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c9607 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528774.279480:0:25102:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788528774.279485:0:25102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2e00/0x892c60dda91c9600 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c9607 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528774.279492:0:25102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8a8fc26e2e00/0x892c60dda91c9600 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x892c60dda91c9607 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528774.279514:0:25102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528774.279516:0:25102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528774.279518:0:25102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528774.279524:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528774.279536:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07f6b94a-1259-41bf-8282-a67e1c8aef03:3637:1875407735625216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788528774.279588:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528774.279614:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788528774.279619:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07f6b94a-1259-41bf-8282-a67e1c8aef03:3637:1875407735625344:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788528774.279640:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528774.279668:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735625216 00000100:00100000:0.0:1788528774.279672:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735625216 00010000:00010000:0.0:1788528774.279694:0:22743:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9101850800/0x892c60dda91c9662 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c965b expref: 27 pid: 22698 timeout: 743 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528774.279715:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735625344 00000100:00100000:0.0:1788528774.279718:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735625344 00010000:00010000:0.0:1788528774.279730:0:22743:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c9615 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c960e expref: 28 pid: 22698 timeout: 743 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528774.279749:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788528774.279756:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07f6b94a-1259-41bf-8282-a67e1c8aef03+28:3637:x1875407735625216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788528774.279766:0:22743:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528774.279771:0:22743:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9101850800/0x892c60dda91c9662 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c965b expref: 28 pid: 22698 timeout: 743 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528774.279781:0:22743:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9101850800/0x892c60dda91c9662 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c965b expref: 28 pid: 22698 timeout: 743 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528774.279804:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9101850800/0x892c60dda91c9662 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c965b expref: 28 pid: 22698 timeout: 743 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528774.279817:0:22743:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528774.279858:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07f6b94a-1259-41bf-8282-a67e1c8aef03+27:3637:x1875407735625216:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528774.279865:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788528774.279881:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788528774.279888:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07f6b94a-1259-41bf-8282-a67e1c8aef03+26:3637:x1875407735625344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788528774.279895:0:22743:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528774.279899:0:22743:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c9615 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c960e expref: 26 pid: 22698 timeout: 743 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528774.279907:0:22743:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c9615 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c960e expref: 26 pid: 22698 timeout: 743 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528774.279916:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a8fc26e3200/0x892c60dda91c9615 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c960e expref: 26 pid: 22698 timeout: 743 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528774.279924:0:22743:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528774.279955:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07f6b94a-1259-41bf-8282-a67e1c8aef03+25:3637:x1875407735625344:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528774.279962:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788528774.279996:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07f6b94a-1259-41bf-8282-a67e1c8aef03:3637:1875407735625344:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788528774.280003:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07f6b94a-1259-41bf-8282-a67e1c8aef03:3637:1875407735625216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788528774.280304:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07f6b94a-1259-41bf-8282-a67e1c8aef03:3639:1875407735625472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788528774.280335:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528774.280368:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788528774.280373:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07f6b94a-1259-41bf-8282-a67e1c8aef03:3639:1875407735625088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788528774.280394:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528774.280424:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735625472 00000100:00100000:2.0:1788528774.280428:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735625472 00010000:00010000:2.0:1788528774.280448:0:22692:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9101850c00/0x892c60dda91c9607 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c9600 expref: 25 pid: 22699 timeout: 743 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528774.280464:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735625088 00000100:00100000:2.0:1788528774.280467:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735625088 00010000:00010000:2.0:1788528774.280478:0:22692:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a90c784fa00/0x892c60dda91c970a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c9703 expref: 26 pid: 22698 timeout: 743 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528774.280505:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788528774.280510:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6bc8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07f6b94a-1259-41bf-8282-a67e1c8aef03+26:3639:x1875407735625472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788528774.280518:0:22692:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528774.280524:0:22692:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9101850c00/0x892c60dda91c9607 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c9600 expref: 26 pid: 22699 timeout: 743 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528774.280532:0:22692:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9101850c00/0x892c60dda91c9607 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c9600 expref: 26 pid: 22699 timeout: 743 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528774.280543:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9101850c00/0x892c60dda91c9607 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c9600 expref: 26 pid: 22699 timeout: 743 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528774.280580:0:22692:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528774.280609:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6bc8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07f6b94a-1259-41bf-8282-a67e1c8aef03+25:3639:x1875407735625472:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528774.280618:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788528774.280632:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788528774.280638:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3ff1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07f6b94a-1259-41bf-8282-a67e1c8aef03+24:3639:x1875407735625088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788528774.280645:0:22692:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528774.280649:0:22692:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a90c784fa00/0x892c60dda91c970a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x892c60dda91c9703 expref: 24 pid: 22698 timeout: 743 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528774.280657:0:22692:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a90c784fa00/0x892c60dda91c970a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x892c60dda91c9703 expref: 24 pid: 22698 timeout: 743 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528774.280667:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c784fa00/0x892c60dda91c970a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x892c60dda91c9703 expref: 24 pid: 22698 timeout: 743 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528774.280685:0:22692:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528774.280709:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3ff1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07f6b94a-1259-41bf-8282-a67e1c8aef03+23:3639:x1875407735625088:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528774.280715:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788528774.280739:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07f6b94a-1259-41bf-8282-a67e1c8aef03:3639:1875407735625088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788528774.280747:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07f6b94a-1259-41bf-8282-a67e1c8aef03:3639:1875407735625472:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788528774.281282:0:22689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1788528774.281292:0:22689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07f6b94a-1259-41bf-8282-a67e1c8aef03+3:25733:x1875407735624832:12345-0@lo:104: Request processed in 10198us (10255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528774.281300:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788528774.281451:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528774.281519:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528774.281540:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719786112 00000100:00100000:2.0:1788528774.281545:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719786112 00010000:00010000:2.0:1788528774.281589:0:22691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a90c0030800/0x892c60dda91c999c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c02e9 expref: 14 pid: 22699 timeout: 743 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528774.281610:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719786240 00000100:00100000:2.0:1788528774.281614:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719786240 00010000:00010000:2.0:1788528774.281624:0:22691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a90f6f3a400/0x892c60dda91c9956 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0272 expref: 15 pid: 22698 timeout: 743 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528774.281640:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 13 00000100:00100000:2.0:1788528774.281645:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e28c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+15:2404:x1875407719786112:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788528774.281654:0:22691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528774.281658:0:22691:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a90c0030800/0x892c60dda91c999c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c02e9 expref: 15 pid: 22699 timeout: 743 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528774.281667:0:22691:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a90c0030800/0x892c60dda91c999c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c02e9 expref: 15 pid: 22699 timeout: 743 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528774.281691:0:22691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528774.281732:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e28c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+15:2404:x1875407719786112:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 85us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528774.281739:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 13 00000100:00100000:2.0:1788528774.281787:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 14 00000100:00100000:2.0:1788528774.281795:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+14:2404:x1875407719786240:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788528774.281802:0:22691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528774.281806:0:22691:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a90f6f3a400/0x892c60dda91c9956 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0272 expref: 14 pid: 22698 timeout: 743 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528774.281815:0:22691:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a90f6f3a400/0x892c60dda91c9956 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0272 expref: 14 pid: 22698 timeout: 743 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528774.281837:0:22691:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a90f6f3be00/0x892c60dda91c99cd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528774.281845:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90f6f3be00/0x892c60dda91c99cd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528774.281859:0:22691:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a90f6f3be00/0x892c60dda91c99cd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528774.281866:0:22691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a90f6f3be00/0x892c60dda91c99cd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528774.281872:0:22691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a90f6f3be00/0x892c60dda91c99cd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528774.281879:0:22691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a90f6f3be00/0x892c60dda91c99cd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528774.281889:0:22691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3be00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:2.0:1788528774.281893:0:22691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a90f6f3be00/0x892c60dda91c99cd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528774.281901:0:22691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a90f6f3be00/0x892c60dda91c99cd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528774.281909:0:22691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a90f6f3be00/0x892c60dda91c99cd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528774.281918:0:22691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528774.281938:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+14:2404:x1875407719786240:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 144us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528774.281952:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 14 00010000:00010000:3.0:1788528774.282540:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90c0030800/0x892c60dda91c999c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c02e9 expref: 13 pid: 22699 timeout: 743 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528774.282588:0:25733:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3e55880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25733:1875407735624320:192.168.203.38@tcp:104: 00010000:00010000:3.0:1788528774.282602:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90f6f3a400/0x892c60dda91c9956 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0272 expref: 12 pid: 22698 timeout: 743 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528774.282610:0:25733:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3e57b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25733:1875407735624448:192.168.203.38@tcp:104: 00010000:00010000:3.0:1788528774.282643:0:25733:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a90f6f3be00/0x892c60dda91c99cd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528774.282652:0:25733:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a90f6f3be00/0x892c60dda91c99cd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528774.282658:0:25733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a90f6f3be00/0x892c60dda91c99cd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528774.282664:0:25733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a90f6f3be00/0x892c60dda91c99cd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528774.285575:0:25102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528774.287042:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788528774.339111:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788528774.913262:0:22740:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788528775.302713:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528775.303460:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719786368 00000100:00100000:3.0:1788528775.303475:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719786368 00000100:00100000:3.0:1788528775.303545:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 156 00000100:00100000:3.0:1788528775.303588:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5892050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+12:18075:x1875407719786368:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788528775.303605:0:22700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528775.303625:0:22700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90f6f3be00/0x892c60dda91c99d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c0321 expref: -99 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528775.303651:0:22700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90f6f3be00/0x892c60dda91c99d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0321 expref: 13 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528775.303662:0:22700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90f6f3be00/0x892c60dda91c99d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0321 expref: 13 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528775.303671:0:22700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3be00, rc 0) 00000100:00100000:3.0:1788528775.303734:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5892050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+13:18075:x1875407719786368:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 Request processed in 179us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528775.303741:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 156 00000100:00100000:2.0:1788528775.307022:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528775.307118:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719786496 00000100:00100000:1.0:1788528775.307128:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719786496 00000100:00100000:1.0:1788528775.307186:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 157 00000100:00100000:1.0:1788528775.307196:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5890450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+13:18075:x1875407719786496:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788528775.307352:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5890450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+13:18075:x1875407719786496:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 Request processed in 157us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528775.307361:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 157 00000100:00100000:2.0:1788528775.309805:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528775.309953:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719786624 00000100:00100000:3.0:1788528775.309964:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719786624 00000100:00100000:3.0:1788528775.310020:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 158 00000100:00100000:3.0:1788528775.310030:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5891050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+13:18075:x1875407719786624:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788528775.311245:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5891050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+13:18075:x1875407719786624:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 Request processed in 1209us (1440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528775.311258:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 158 00000100:00100000:0.0:1788528775.317316:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528775.317592:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719786752 00000100:00100000:3.0:1788528775.317617:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719786752 00000100:00100000:3.0:1788528775.317678:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 159 00000100:00100000:3.0:1788528775.317688:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5893c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+13:18075:x1875407719786752:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788528775.317704:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528775.317854:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90f6f3a400/0x892c60dda91c99db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c0328 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528775.317886:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90f6f3a400/0x892c60dda91c99db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0328 expref: 14 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528775.317897:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90f6f3a400/0x892c60dda91c99db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0328 expref: 14 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528775.317906:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3a400, rc 0) 00000100:00100000:3.0:1788528775.317961:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5893c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+14:18075:x1875407719786752:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 Request processed in 274us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528775.317968:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 159 00000100:00100000:2.0:1788528775.328654:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528775.328746:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719786880 00000100:00100000:3.0:1788528775.328756:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719786880 00000100:00100000:3.0:1788528775.328833:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 160 00000100:00100000:3.0:1788528775.328842:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5890050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+14:18075:x1875407719786880:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788528775.329135:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5890050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+14:18075:x1875407719786880:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 Request processed in 293us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528775.329144:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 160 00000100:00100000:2.0:1788528775.332182:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528775.332274:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719787008 00000100:00100000:3.0:1788528775.332283:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719787008 00000100:00100000:3.0:1788528775.332351:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 161 00000100:00100000:3.0:1788528775.332362:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5892850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+14:18075:x1875407719787008:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788528775.332527:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5892850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+14:18075:x1875407719787008:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 Request processed in 166us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528775.332536:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 161 00010000:00010000:0.0:1788528775.359868:0:25102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788528775.941449:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528775.941873:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719787136 00000100:00100000:1.0:1788528775.941895:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719787136 00000100:00100000:1.0:1788528775.942057:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23 00000100:00100000:1.0:1788528775.942068:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:333a2baa-d5e5-441e-8b53-5d69075ed300+6:18696:x1875407719787136:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788528775.942087:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528775.942106:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551e00/0x892c60dda91c99e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c032f expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528775.942163:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551a00/0x892c60dda91c99e9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528775.942177:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551a00/0x892c60dda91c99e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528775.942189:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551a00/0x892c60dda91c99e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528775.942203:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551800/0x892c60dda91c99f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528775.942209:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551800/0x892c60dda91c99f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528775.942215:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551800/0x892c60dda91c99f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528775.942288:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551400/0x892c60dda91c99f7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528775.942295:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551400/0x892c60dda91c99f7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528775.942302:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551400/0x892c60dda91c99f7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788528775.942337:0:22706:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788528775.942341:0:22706:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788528775.942375:0:22706:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551400/0x892c60dda91c99f7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528775.942385:0:22706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551a00/0x892c60dda91c99e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528775.942391:0:22706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551a00/0x892c60dda91c99e9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528775.942397:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551a00/0x892c60dda91c99e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528775.942403:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c1551a00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528775.942407:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551a00/0x892c60dda91c99e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528775.942413:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551a00/0x892c60dda91c99e9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528775.942424:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a91021e1600) 00010000:00010000:1.0:1788528775.942427:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788528775.942431:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551a00/0x892c60dda91c99e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528775.942437:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551a00/0x892c60dda91c99e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528775.942449:0:22706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551800/0x892c60dda91c99f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528775.942464:0:22706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551800/0x892c60dda91c99f0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528775.942470:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551800/0x892c60dda91c99f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528775.942476:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c1551800 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528775.942479:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551800/0x892c60dda91c99f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528775.942485:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551800/0x892c60dda91c99f0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528775.942492:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8a8fc1fab000) 00010000:00010000:1.0:1788528775.942495:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788528775.942497:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551800/0x892c60dda91c99f0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528775.942503:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551800/0x892c60dda91c99f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528775.942530:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551e00/0x892c60dda91c99e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c032f expref: 8 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528775.942542:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551400/0x892c60dda91c99f7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c032f expref: 7 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528775.942549:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a8fc1fabe00) 00010000:00010000:1.0:1788528775.942602:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788528775.942610:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c1551400, rc 0) 00000100:00100000:1.0:1788528775.942662:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:333a2baa-d5e5-441e-8b53-5d69075ed300+7:18696:x1875407719787136:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 597us (1228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528775.942669:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23 00000100:00080000:2.0:1788528775.942792:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788528775.951260:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528775.951360:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719787264 00000100:00100000:1.0:1788528775.951370:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719787264 00000100:00100000:1.0:1788528775.951426:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:1.0:1788528775.951436:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3ff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:333a2baa-d5e5-441e-8b53-5d69075ed300+7:18696:x1875407719787264:12345-192.168.203.38@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788528775.954588:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3ff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:333a2baa-d5e5-441e-8b53-5d69075ed300+7:18696:x1875407719787264:12345-192.168.203.38@tcp:900:lhsmtool_posix.0 Request processed in 3140us (3323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528775.954603:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:2.0:1788528775.964330:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528775.964405:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719787520 00000100:00100000:3.0:1788528775.964415:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719787520 00000100:00100000:3.0:1788528775.964474:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 24 00000100:00100000:3.0:1788528775.964483:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+7:18696:x1875407719787520:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788528775.964502:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528775.964522:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c99fe lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c0336 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528775.964615:0:22705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c9a05 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528775.964629:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c9a05 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528775.964639:0:22705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c9a05 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528775.964652:0:22705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c9a0c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528775.964659:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c9a0c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528775.964665:0:22705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c9a0c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528775.964772:0:22705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ac00/0x892c60dda91c9a13 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528775.964792:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ac00/0x892c60dda91c9a13 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528775.964798:0:22705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ac00/0x892c60dda91c9a13 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788528775.964807:0:22705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1788528775.964970:0:22705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c9a05 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528775.964977:0:22705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c9a05 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528775.964984:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c9a05 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528775.964990:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3ba00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528775.964994:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c9a05 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528775.965001:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c9a05 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528775.965013:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a8fc1fabe00) 00010000:00010000:3.0:1788528775.965016:0:22705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528775.965020:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c9a05 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528775.965026:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c9a05 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528775.965038:0:22705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c9a0c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528775.965049:0:22705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c9a0c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528775.965054:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c9a0c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528775.965059:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3a600 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528775.965063:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c9a0c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528775.965069:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c9a0c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528775.965077:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8a8fc1fa9500) 00010000:00010000:3.0:1788528775.965079:0:22705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528775.965082:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c9a0c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528775.965088:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c9a0c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528775.965853:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c99fe lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0336 expref: 10 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528775.965870:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ac00/0x892c60dda91c9a13 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0336 expref: 9 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528775.965878:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a8fc1fa9f00) 00010000:00010000:3.0:1788528775.965880:0:22705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528775.965890:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3ac00, rc 0) 00000100:00100000:3.0:1788528775.965964:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+9:18696:x1875407719787520:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 1481us (1644us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1788528775.965971:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 24 00000100:00100000:0.0:1788528775.979675:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528775.984267:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719787648 00000100:00100000:3.0:1788528775.984282:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719787648 00000100:00100000:3.0:1788528775.984420:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 25 00000100:00100000:3.0:1788528775.984432:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:333a2baa-d5e5-441e-8b53-5d69075ed300+9:18696:x1875407719787648:12345-192.168.203.38@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788528775.984548:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:333a2baa-d5e5-441e-8b53-5d69075ed300+9:18696:x1875407719787648:12345-192.168.203.38@tcp:59:lhsmtool_posix.0 Request processed in 118us (4881us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528775.984585:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 25 00000100:00100000:2.0:1788528775.994940:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528775.995145:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719787776 00000100:00100000:3.0:1788528775.995153:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719787776 00000100:00100000:3.0:1788528775.995220:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 26 00000100:00100000:3.0:1788528775.995229:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3ff3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+5:18696:x1875407719787776:12345-192.168.203.38@tcp:59:lhsmtool_posix.0 00000100:00080000:2.0:1788528775.995464:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1788528775.997014:0:22705:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1747us 00000100:00100000:0.0:1788528776.014618:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3ff3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+5:18696:x1875407719787776:12345-192.168.203.38@tcp:59:lhsmtool_posix.0 Request processed in 19381us (19679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528776.014631:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 26 00000100:00100000:2.0:1788528776.020267:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528776.020869:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719787904 00000100:00100000:3.0:1788528776.020880:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719787904 00000100:00100000:3.0:1788528776.020987:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 27 00000100:00100000:3.0:1788528776.020998:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3ff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:333a2baa-d5e5-441e-8b53-5d69075ed300+9:18702:x1875407719787904:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1788528776.021018:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528776.021037:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c9a21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c033d expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.021098:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c9a28 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.021140:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c9a28 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.021151:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c9a28 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.021166:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c9a2f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.021174:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c9a2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.021181:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c9a2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.021221:0:22706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c9a28 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.021228:0:22706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c9a28 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.021235:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c9a28 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.021241:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3a600 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528776.021245:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c9a28 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.021253:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c9a28 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.021266:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a91021e1600) 00010000:00010000:3.0:1788528776.021275:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528776.021281:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c9a28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.021287:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c9a28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.021371:0:22706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c9a2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.021377:0:22706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c9a2f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.021380:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c9a2f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.021383:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3ba00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528776.021385:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c9a2f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.021389:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c9a2f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.021394:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8a8fc1fa9500) 00010000:00010000:3.0:1788528776.021396:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528776.021398:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c9a2f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.021402:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c9a2f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.021485:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c9a21 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c033d expref: 10 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.021497:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a91021e1600) 00010000:00010000:3.0:1788528776.021499:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528776.021501:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b600/0x892c60dda91c9a21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c033d expref: 10 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.021507:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3b600, rc 0) 00000100:00100000:3.0:1788528776.021835:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3ff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:333a2baa-d5e5-441e-8b53-5d69075ed300+9:18702:x1875407719787904:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 838us (1577us total) trans 0 rc 301/301 00000100:00100000:3.0:1788528776.021843:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 27 00000100:00100000:3.0:1788528776.029717:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528776.029793:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719788032 00000100:00100000:0.0:1788528776.029803:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719788032 00000100:00100000:0.0:1788528776.029868:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:0.0:1788528776.029878:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:333a2baa-d5e5-441e-8b53-5d69075ed300+9:18702:x1875407719788032:12345-192.168.203.38@tcp:700:lfs.0 00000100:00100000:0.0:1788528776.029961:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:333a2baa-d5e5-441e-8b53-5d69075ed300+9:18702:x1875407719788032:12345-192.168.203.38@tcp:700:lfs.0 Request processed in 84us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528776.029969:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:2.0:1788528776.035970:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528776.036030:0:25501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719788288 00000100:00100000:0.0:1788528776.036040:0:25501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719788288 00000100:00100000:0.0:1788528776.036105:0:25501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 28 00000100:00100000:0.0:1788528776.036115:0:25501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:333a2baa-d5e5-441e-8b53-5d69075ed300+9:18702:x1875407719788288:12345-192.168.203.38@tcp:36:lfs.0 00010000:00010000:0.0:1788528776.036178:0:25501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528776.036205:0:25501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db000/0x892c60dda91c9980 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c02a3 expref: 9 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528776.036224:0:25501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a91021e1600) 00010000:00010000:0.0:1788528776.036230:0:25501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788528776.036289:0:25501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c9a36 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528776.036313:0:25501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dac00/0x892c60dda91c99c6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c031a expref: 5 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528776.036320:0:25501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c9a36 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528776.036344:0:25501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dac00/0x892c60dda91c99c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c031a expref: 5 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528776.036353:0:25501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dac00/0x892c60dda91c99c6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c031a expref: 5 pid: 22707 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528776.036364:0:25501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25501:1875407735625600:192.168.203.38@tcp:104: 00000100:00100000:0.0:1788528776.036438:0:25501:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c82bd180 going to sleep for 11 seconds 00000100:00100000:3.0:1788528776.043191:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528776.043332:0:25501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25501:1875407735625600:192.168.203.38@tcp:104: 00010000:00010000:0.0:1788528776.043360:0:25501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c9a36 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528776.043432:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719788416 00000100:00100000:2.0:1788528776.043440:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719788416 00010000:00010000:2.0:1788528776.043490:0:22691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dac00/0x892c60dda91c99c6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c031a expref: 6 pid: 22707 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528776.043540:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 15 00000100:00100000:2.0:1788528776.043549:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:86b97e15-e0df-43d0-a2df-10bdbaf02f48+6:2403:x1875407719788416:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788528776.043594:0:22691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528776.043601:0:22691:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dac00/0x892c60dda91c99c6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c031a expref: 6 pid: 22707 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528776.043613:0:22691:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dac00/0x892c60dda91c99c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c031a expref: 6 pid: 22707 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528776.043633:0:22691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dac00/0x892c60dda91c99c6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c031a expref: 6 pid: 22707 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528776.043656:0:22691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a91021e1600) 00010000:00010000:2.0:1788528776.043660:0:22691:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c9a36 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528776.043669:0:22691:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c9a36 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528776.043675:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c9a36 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528776.043698:0:22691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:3.0:1788528776.043807:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788528776.044107:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:86b97e15-e0df-43d0-a2df-10bdbaf02f48+5:2403:x1875407719788416:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 557us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528776.044115:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 15 00010000:00010000:1.0:1788528776.044124:0:25501:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c9a36 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.044135:0:25501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c9a36 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.044160:0:25501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551800/0x892c60dda91c9a3d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.044172:0:25501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551800/0x892c60dda91c9a3d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.044180:0:25501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551800/0x892c60dda91c9a3d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.045520:0:25501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551a00/0x892c60dda91c9a44 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.045538:0:25501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551a00/0x892c60dda91c9a44 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.045732:0:25501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551a00/0x892c60dda91c9a44 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788528776.045753:0:25501:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003c83ca56 reply state 00000000619e11ea transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551a00/0x892c60dda91c9a44 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.045764:0:25501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551a00/0x892c60dda91c9a44 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.045771:0:25501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8a8fc1fab700) 00010000:00010000:1.0:1788528776.045774:0:25501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788528776.045778:0:25501:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788528776.045784:0:25501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788528776.045791:0:25501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c9a36 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.045798:0:25501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c9a36 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.045805:0:25501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c9a36 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.045824:0:25501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0031c00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528776.045828:0:25501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c9a36 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.045836:0:25501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c9a36 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.045846:0:25501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a91021e1600) 00010000:00010000:1.0:1788528776.045848:0:25501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788528776.045858:0:25501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c9a36 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.045865:0:25501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c9a36 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788528776.045884:0:25501:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003c83ca56 reply state 00000000619e11ea transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551800/0x892c60dda91c9a3d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.045892:0:25501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551800/0x892c60dda91c9a3d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.045899:0:25501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8a8fc1fab000) 00010000:00010000:1.0:1788528776.045901:0:25501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788528776.045903:0:25501:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788528776.046398:0:25501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:333a2baa-d5e5-441e-8b53-5d69075ed300+10:18702:x1875407719788288:12345-192.168.203.38@tcp:36:lfs.0 Request processed in 10281us (10677us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1788528776.046407:0:25501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 28 00000100:00100000:3.0:1788528776.165698:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528776.165994:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719788544 00000100:00100000:0.0:1788528776.166006:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719788544 00000100:00100000:0.0:1788528776.166066:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 29 00000100:00100000:0.0:1788528776.166087:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:333a2baa-d5e5-441e-8b53-5d69075ed300+10:18710:x1875407719788544:12345-192.168.203.38@tcp:101:lctl.0 00010000:00010000:0.0:1788528776.166110:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528776.166133:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c9a4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c0344 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528776.166541:0:22707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030a00/0x892c60dda91c9a52 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528776.166678:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030a00/0x892c60dda91c9a52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528776.166690:0:22707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030a00/0x892c60dda91c9a52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788528776.168651:0:22707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788528776.168661:0:22707:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788528776.168720:0:22707:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030a00/0x892c60dda91c9a52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.168757:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031c00/0x892c60dda91c9a4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0344 expref: 12 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.168779:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030a00/0x892c60dda91c9a52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0344 expref: 11 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.168788:0:22707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a8fc264ea00) 00010000:00010000:1.0:1788528776.168790:0:22707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788528776.168805:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0030a00, rc 0) 00000100:00100000:1.0:1788528776.168888:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:333a2baa-d5e5-441e-8b53-5d69075ed300+11:18710:x1875407719788544:12345-192.168.203.38@tcp:101:lctl.0 Request processed in 2803us (3197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528776.168897:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 29 10000000:01000000:2.0:1788528776.190670:0:22702:0:(mgc_request.c:714:do_requeue()) updating log params 10000000:01000000:2.0:1788528776.190690:0:22702:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff8a8fc4779000 from 13 10000000:01000000:2.0:1788528776.190694:0:22702:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788528776.190730:0:22702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c68dac00/0x892c60dda91c9a59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528776.190738:0:22702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c68dac00/0x892c60dda91c9a59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528776.190746:0:22702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c68dac00/0x892c60dda91c9a59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528776.190765:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3ff0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735625728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788528776.190835:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528776.190943:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c82e2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788528776.198130:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735625728 00000100:00100000:3.0:1788528776.198146:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735625728 00000100:00100000:3.0:1788528776.198219:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788528776.198230:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5892450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+23:22702:x1875407735625728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788528776.198247:0:22700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528776.198277:0:22700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90f6f3b600/0x892c60dda91c9a60 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c9a59 expref: -99 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.198304:0:22700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90f6f3b600/0x892c60dda91c9a60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c9a59 expref: 24 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.198315:0:22700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90f6f3b600/0x892c60dda91c9a60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c9a59 expref: 24 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.198341:0:22700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3b600, rc 0) 00000100:00100000:3.0:1788528776.198424:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5892450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+24:22702:x1875407735625728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 196us (7587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528776.198431:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788528776.200144:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3ff0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735625728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788528776.200174:0:22702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c68dac00/0x892c60dda91c9a59 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9a60 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528776.200185:0:22702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c68dac00/0x892c60dda91c9a59 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c9a60 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788528776.200366:0:22702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 13 count 13 00000040:00080000:2.0:1788528776.200667:0:22702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788528776.200861:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].1, 224 off8416 00000040:00080000:2.0:1788528776.200886:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].2, 112 off8528 00000040:00080000:2.0:1788528776.200899:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].3, 224 off8752 00000040:00080000:2.0:1788528776.200911:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].4, 224 off8976 00000040:00080000:2.0:1788528776.200922:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].5, 112 off9088 00000040:00080000:2.0:1788528776.200947:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].6, 224 off9312 00000040:00080000:2.0:1788528776.200965:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].7, 224 off9536 00000040:00080000:2.0:1788528776.200979:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].8, 128 off9664 00000040:00080000:2.0:1788528776.201006:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].9, 224 off9888 00000040:00080000:2.0:1788528776.201018:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].10, 224 off10112 00000040:00080000:2.0:1788528776.201031:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].11, 128 off10240 00000040:00080000:2.0:1788528776.201047:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].12, 224 off10464 00000040:00080000:2.0:1788528776.201051:0:22702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 12 count 13 00000100:00100000:2.0:1788528776.201114:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3ff0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735625856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788528776.201170:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528776.201210:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c82e2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788528776.201689:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735625856 00000100:00100000:3.0:1788528776.201697:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735625856 00000100:00100000:3.0:1788528776.201748:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788528776.201756:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5893450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+24:22702:x1875407735625856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788528776.201879:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5893450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+24:22702:x1875407735625856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 123us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528776.201887:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788528776.202047:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528776.202221:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719788672 00000100:00100000:3.0:1788528776.202226:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719788672 00000100:00100000:2.0:1788528776.202458:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3ff0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735625856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788528776.202501:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3ff0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735625984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788528776.202548:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528776.202608:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c82e2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788528776.202661:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735625984 00000100:00100000:0.0:1788528776.202666:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735625984 00000100:00100000:0.0:1788528776.202704:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788528776.202712:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5891850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+24:22702:x1875407735625984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788528776.202826:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5891850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+24:22702:x1875407735625984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528776.202833:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788528776.202929:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 30 00000100:00100000:3.0:1788528776.202949:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86b97e15-e0df-43d0-a2df-10bdbaf02f48+5:18711:x1875407719788672:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1788528776.202962:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528776.202981:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c9a67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c034b expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.203039:0:22705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c9a6e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.203052:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c9a6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.203063:0:22705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c9a6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788528776.203124:0:22705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788528776.203129:0:22705:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788528776.203147:0:22705:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c9a6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.203170:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c9a67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c034b expref: 7 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.203186:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a600/0x892c60dda91c9a6e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c034b expref: 6 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.203195:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a8fc264ea00) 00010000:00010000:3.0:1788528776.203198:0:22705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788528776.203201:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3a600, rc 0) 00000100:00100000:3.0:1788528776.203259:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86b97e15-e0df-43d0-a2df-10bdbaf02f48+6:18711:x1875407719788672:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 312us (1214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528776.203889:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 30 00000100:00100000:2.0:1788528776.203986:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3ff0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735625984:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788528776.207115:0:22702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788528776.207219:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3ff0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735626112:0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788528776.207431:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528776.207469:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c82e2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788528776.207695:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735626112 00000100:00100000:0.0:1788528776.207702:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735626112 00000100:00100000:0.0:1788528776.207749:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788528776.207759:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5891c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+24:22702:x1875407735626112:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788528776.207885:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5891c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+24:22702:x1875407735626112:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 128us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528776.207893:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788528776.210101:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3ff0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735626112:0@lo:502:ll_cfg_requeue.0 00000040:00080000:2.0:1788528776.210576:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].1, 224 off8416 00000040:00080000:2.0:1788528776.210608:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].2, 112 off8528 00000040:00080000:2.0:1788528776.210624:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].3, 224 off8752 00000040:00080000:2.0:1788528776.210640:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].4, 224 off8976 00000040:00080000:2.0:1788528776.210653:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].5, 112 off9088 00000040:00080000:2.0:1788528776.210666:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].6, 224 off9312 00000040:00080000:2.0:1788528776.210679:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].7, 224 off9536 00000040:00080000:2.0:1788528776.210693:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].8, 128 off9664 00000040:00080000:2.0:1788528776.210710:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].9, 224 off9888 00000040:00080000:2.0:1788528776.210737:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].10, 224 off10112 00000040:00080000:2.0:1788528776.210752:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].11, 128 off10240 00000100:00100000:2.0:1788528776.210789:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3ff0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735626240:0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788528776.210871:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528776.213258:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c82e2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788528776.214599:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528776.214726:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719788800 00000100:00100000:3.0:1788528776.214737:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719788800 00000100:00100000:3.0:1788528776.214788:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 31 00000100:00100000:3.0:1788528776.214798:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86b97e15-e0df-43d0-a2df-10bdbaf02f48+6:18711:x1875407719788800:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1788528776.214828:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528776.214849:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b800/0x892c60dda91c9a75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c0352 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.214915:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ae00/0x892c60dda91c9a7c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.215147:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ae00/0x892c60dda91c9a7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.215158:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ae00/0x892c60dda91c9a7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.215172:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c9a83 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.215179:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c9a83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.215185:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c9a83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.215454:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b200/0x892c60dda91c9a8a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.215464:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b200/0x892c60dda91c9a8a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.215471:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b200/0x892c60dda91c9a8a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788528776.215510:0:22706:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788528776.215515:0:22706:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788528776.215535:0:22706:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b200/0x892c60dda91c9a8a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.215548:0:22706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ae00/0x892c60dda91c9a7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.215716:0:22706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ae00/0x892c60dda91c9a7c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.215723:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ae00/0x892c60dda91c9a7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.215730:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3ae00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528776.215734:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ae00/0x892c60dda91c9a7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.215742:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ae00/0x892c60dda91c9a7c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.215754:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a8fc264ea00) 00010000:00010000:3.0:1788528776.215757:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528776.215761:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ae00/0x892c60dda91c9a7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.215767:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ae00/0x892c60dda91c9a7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.215778:0:22706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c9a83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.215784:0:22706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c9a83 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.215790:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c9a83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.215795:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3a000 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528776.215805:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c9a83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.215828:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c9a83 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.215837:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8a8fc1fab000) 00010000:00010000:3.0:1788528776.215839:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528776.215843:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c9a83 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.215849:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c9a83 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.215876:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b800/0x892c60dda91c9a75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0352 expref: 8 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.215889:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b200/0x892c60dda91c9a8a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0352 expref: 7 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.215896:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8a8fc1fab700) 00010000:00010000:3.0:1788528776.215898:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788528776.215900:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3b200, rc 0) 00000100:00100000:0.0:1788528776.216651:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735626240 00000100:00100000:0.0:1788528776.216659:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735626240 00000100:00100000:3.0:1788528776.216828:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86b97e15-e0df-43d0-a2df-10bdbaf02f48+7:18711:x1875407719788800:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 2029us (2233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528776.216837:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 31 00000100:00100000:0.0:1788528776.218946:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788528776.219089:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5893850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+24:22702:x1875407735626240:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788528776.221316:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5893850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+24:22702:x1875407735626240:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 2352us (10438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528776.221343:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788528776.221416:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3ff0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735626240:0@lo:502:ll_cfg_requeue.0 00000040:00080000:2.0:1788528776.221507:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].12, 224 off10464 00000040:00080000:2.0:1788528776.221521:0:22702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000040:00080000:2.0:1788528776.223854:0:25748:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 64768 count 13 00000020:01000000:0.0:1788528776.224163:0:22702:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788528776.224180:0:22702:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788528776.224193:0:22702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c68dac00/0x892c60dda91c9a59 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9a60 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528776.224214:0:22702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c68dac00/0x892c60dda91c9a59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9a60 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788528776.224232:0:22702:0:(mgc_request.c:714:do_requeue()) updating log params 10000000:01000000:0.0:1788528776.224234:0:22702:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff8a90f6f35800 from 13 10000000:01000000:0.0:1788528776.224237:0:22702:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788528776.224348:0:22702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0031200/0x892c60dda91c9a91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528776.224357:0:22702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c0031200/0x892c60dda91c9a91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528776.224367:0:22702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c0031200/0x892c60dda91c9a91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528776.224390:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3c7e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735626368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788528776.224450:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528776.224547:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c82fb480 going to sleep for 11 seconds 00000100:00100000:1.0:1788528776.227159:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735626368 00000100:00100000:1.0:1788528776.227174:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735626368 00000100:00100000:1.0:1788528776.227405:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788528776.227417:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5890850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+24:22702:x1875407735626368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788528776.227434:0:22699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528776.227452:0:22699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c1550a00/0x892c60dda91c9a98 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c9a91 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.227482:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c1550a00/0x892c60dda91c9a98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c9a91 expref: 25 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.227494:0:22699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c1550a00/0x892c60dda91c9a98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c9a91 expref: 25 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.227503:0:22699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c1550a00, rc 0) 00000100:00100000:1.0:1788528776.227646:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5890850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+25:22702:x1875407735626368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 232us (3195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528776.227652:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788528776.227730:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3c7e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735626368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788528776.227749:0:22702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c0031200/0x892c60dda91c9a91 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9a98 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528776.227759:0:22702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c0031200/0x892c60dda91c9a91 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c9a98 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788528776.227940:0:22702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 13 count 13 00000040:00080000:2.0:1788528776.228225:0:22702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788528776.228748:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528776.228778:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719788928 00000100:00100000:3.0:1788528776.228784:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719788928 00000100:00100000:3.0:1788528776.228840:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:3.0:1788528776.228862:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:86b97e15-e0df-43d0-a2df-10bdbaf02f48+5:18711:x1875407719788928:12345-192.168.203.38@tcp:900:lfs.0 00000100:00100000:3.0:1788528776.228922:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:86b97e15-e0df-43d0-a2df-10bdbaf02f48+5:18711:x1875407719788928:12345-192.168.203.38@tcp:900:lfs.0 Request processed in 60us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528776.228939:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00080000:3.0:1788528776.229033:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:2.0:1788528776.229284:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].1, 224 off8416 00000040:00080000:2.0:1788528776.229316:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].2, 112 off8528 00000040:00080000:2.0:1788528776.229333:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].3, 224 off8752 00000040:00080000:2.0:1788528776.229346:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].4, 224 off8976 00000040:00080000:2.0:1788528776.229357:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].5, 112 off9088 00000040:00080000:2.0:1788528776.229370:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].6, 224 off9312 00000040:00080000:2.0:1788528776.229383:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].7, 224 off9536 00000040:00080000:2.0:1788528776.229394:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].8, 128 off9664 00000040:00080000:2.0:1788528776.229406:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].9, 224 off9888 00000040:00080000:2.0:1788528776.229418:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].10, 224 off10112 00000040:00080000:2.0:1788528776.229444:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].11, 128 off10240 00000040:00080000:2.0:1788528776.229464:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].12, 224 off10464 00000040:00080000:2.0:1788528776.229469:0:22702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 12 count 13 00000100:00100000:2.0:1788528776.229542:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa4f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735626496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788528776.229607:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528776.230490:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c82e23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528776.232437:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735626496 00000100:00100000:0.0:1788528776.232448:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735626496 00000100:00100000:3.0:1788528776.232577:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788528776.232717:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5890c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+25:22702:x1875407735626496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788528776.232893:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5890c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+25:22702:x1875407735626496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 306us (3284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528776.232901:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788528776.233041:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa4f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735626496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788528776.233163:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa69880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735626624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788528776.233476:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528776.233547:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c2d79a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788528776.233640:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735626624 00000100:00100000:1.0:1788528776.233645:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735626624 00000100:00100000:1.0:1788528776.233678:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788528776.233685:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5891450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+25:22702:x1875407735626624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788528776.233785:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5891450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+25:22702:x1875407735626624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528776.233798:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788528776.233893:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa69880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735626624:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788528776.237711:0:22702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788528776.237841:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa69880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735626752:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788528776.237914:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528776.237956:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c2d79a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788528776.237973:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735626752 00000100:00100000:1.0:1788528776.237981:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735626752 00000100:00100000:1.0:1788528776.238027:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788528776.238037:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f5892c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+25:22702:x1875407735626752:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788528776.238147:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f5892c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+25:22702:x1875407735626752:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 111us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528776.238155:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788528776.238363:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa69880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735626752:0@lo:502:ll_cfg_requeue.0 00000040:00080000:3.0:1788528776.238608:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].1, 224 off8416 00000040:00080000:3.0:1788528776.238639:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].2, 112 off8528 00000040:00080000:3.0:1788528776.238652:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].3, 224 off8752 00000040:00080000:3.0:1788528776.238665:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].4, 224 off8976 00000040:00080000:3.0:1788528776.238678:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].5, 112 off9088 00000040:00080000:3.0:1788528776.238707:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].6, 224 off9312 00000040:00080000:3.0:1788528776.238723:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].7, 224 off9536 00000040:00080000:3.0:1788528776.238736:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].8, 128 off9664 00000040:00080000:3.0:1788528776.238749:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].9, 224 off9888 00000040:00080000:3.0:1788528776.238761:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].10, 224 off10112 00000040:00080000:3.0:1788528776.238785:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].11, 128 off10240 00000100:00100000:3.0:1788528776.238821:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90ffa69880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735626880:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788528776.238862:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528776.238893:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c2d79a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788528776.238953:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735626880 00000100:00100000:1.0:1788528776.238958:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735626880 00000100:00100000:1.0:1788528776.238992:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788528776.239000:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c4001850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+25:22702:x1875407735626880:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788528776.239075:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c4001850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+25:22702:x1875407735626880:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 75us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528776.239082:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788528776.239442:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90ffa69880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735626880:0@lo:502:ll_cfg_requeue.0 00000040:00080000:3.0:1788528776.239484:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].12, 224 off10464 00000040:00080000:3.0:1788528776.239493:0:22702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000040:00080000:0.0:1788528776.242355:0:25749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 64768 count 13 00000020:01000000:1.0:1788528776.242655:0:22702:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788528776.242672:0:22702:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788528776.242682:0:22702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c0031200/0x892c60dda91c9a91 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9a98 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.242694:0:22702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c0031200/0x892c60dda91c9a91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9a98 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528776.242710:0:22702:0:(mgc_request.c:714:do_requeue()) updating log params 10000000:01000000:1.0:1788528776.242713:0:22702:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff8a90f5ac8800 from 13 10000000:01000000:1.0:1788528776.242716:0:22702:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788528776.242750:0:22702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c1551e00/0x892c60dda91c9a9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.242769:0:22702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c1551e00/0x892c60dda91c9a9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.242779:0:22702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c1551e00/0x892c60dda91c9a9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528776.242802:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735627008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788528776.242896:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528776.243000:0:25501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719789184 00000100:00100000:3.0:1788528776.243009:0:25501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719789184 00000100:00100000:2.0:1788528776.243138:0:25501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 32 00000100:00100000:2.0:1788528776.243150:0:25501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86b97e15-e0df-43d0-a2df-10bdbaf02f48+7:18711:x1875407719789184:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1788528776.243167:0:25501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1788528776.243174:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788528776.243185:0:25501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dbc00/0x892c60dda91c9aa6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c0359 expref: -99 pid: 25501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528776.243220:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78cd840 going to sleep for 11 seconds 00000004:00200000:2.0:1788528776.243271:0:25501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788528776.243336:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735627008 00000100:00100000:0.0:1788528776.243341:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735627008 00010000:00010000:2.0:1788528776.243367:0:25501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dbc00/0x892c60dda91c9aa6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0359 expref: 9 pid: 25501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528776.243381:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00010000:00010000:2.0:1788528776.243383:0:25501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a8fc264ea00) 00010000:00010000:2.0:1788528776.243387:0:25501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788528776.243394:0:25501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dbc00/0x892c60dda91c9aa6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0359 expref: 9 pid: 25501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528776.243401:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c4003450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+25:22702:x1875407735627008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788528776.243411:0:25501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c68dbc00, rc 0) 00010000:00010000:0.0:1788528776.243412:0:22699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528776.243423:0:22699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c0030800/0x892c60dda91c9ab4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c9a9f expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528776.243443:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c0030800/0x892c60dda91c9ab4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c9a9f expref: 26 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528776.243455:0:22699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c0030800/0x892c60dda91c9ab4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c9a9f expref: 26 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528776.243463:0:22699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0030800, rc 0) 00000100:00100000:2.0:1788528776.243464:0:25501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86b97e15-e0df-43d0-a2df-10bdbaf02f48+8:18711:x1875407719789184:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 315us (569us total) trans 12884901891 rc 301/301 00000100:00100000:2.0:1788528776.243474:0:25501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 32 00000100:00100000:0.0:1788528776.243500:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c4003450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+26:22702:x1875407735627008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528776.243506:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788528776.243602:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735627008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788528776.243619:0:22702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c1551e00/0x892c60dda91c9a9f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9ab4 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.243628:0:22702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c1551e00/0x892c60dda91c9a9f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c9ab4 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788528776.244529:0:22702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2c:0x0] index 13 count 13 00000040:00080000:1.0:1788528776.244852:0:22702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788528776.246259:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].1, 224 off8416 00000040:00080000:1.0:1788528776.246412:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].2, 112 off8528 00000040:00080000:1.0:1788528776.246426:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].3, 224 off8752 00000040:00080000:1.0:1788528776.246438:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].4, 224 off8976 00000040:00080000:1.0:1788528776.246450:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].5, 112 off9088 00000040:00080000:1.0:1788528776.246462:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].6, 224 off9312 00000040:00080000:1.0:1788528776.246473:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].7, 224 off9536 00000040:00080000:1.0:1788528776.246484:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].8, 128 off9664 00000040:00080000:1.0:1788528776.246495:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].9, 224 off9888 00000040:00080000:1.0:1788528776.246507:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].10, 224 off10112 00000040:00080000:1.0:1788528776.246540:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].11, 128 off10240 00000040:00080000:1.0:1788528776.246591:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].12, 224 off10464 00000040:00080000:1.0:1788528776.246598:0:22702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2c:0x0] index 12 count 13 00000100:00100000:1.0:1788528776.246696:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735627136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788528776.246757:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528776.246805:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78cd840 going to sleep for 11 seconds 00000100:00100000:2.0:1788528776.247437:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735627136 00000100:00100000:2.0:1788528776.247446:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735627136 00000100:00100000:2.0:1788528776.247502:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788528776.247512:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c4002450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+26:22702:x1875407735627136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788528776.253979:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c4002450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+26:22702:x1875407735627136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 6459us (7211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528776.253994:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788528776.254271:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735627136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788528776.254332:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735627264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788528776.254405:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528776.254447:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78cd840 going to sleep for 11 seconds 00000100:00100000:3.0:1788528776.254597:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735627264 00000100:00100000:3.0:1788528776.254604:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735627264 00000100:00100000:3.0:1788528776.254646:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788528776.254655:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c4002850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+26:22702:x1875407735627264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788528776.254763:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c4002850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+26:22702:x1875407735627264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528776.254771:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788528776.254936:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735627264:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788528776.255378:0:22702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788528776.255446:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735627392:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788528776.255485:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528776.255514:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78496c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788528776.255822:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735627392 00000100:00100000:3.0:1788528776.255828:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735627392 00000100:00100000:3.0:1788528776.255852:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788528776.255858:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c4000050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+26:22702:x1875407735627392:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788528776.255945:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c4000050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+26:22702:x1875407735627392:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 86us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528776.256038:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788528776.256042:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735627392:0@lo:502:ll_cfg_requeue.0 00000040:00080000:2.0:1788528776.256264:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].1, 224 off8416 00000040:00080000:2.0:1788528776.256298:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].2, 112 off8528 00000040:00080000:2.0:1788528776.256321:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].3, 224 off8752 00000040:00080000:2.0:1788528776.256337:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].4, 224 off8976 00000040:00080000:2.0:1788528776.256353:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].5, 112 off9088 00000040:00080000:2.0:1788528776.256369:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].6, 224 off9312 00000040:00080000:2.0:1788528776.256388:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].7, 224 off9536 00000040:00080000:2.0:1788528776.256406:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].8, 128 off9664 00000040:00080000:2.0:1788528776.256429:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].9, 224 off9888 00000040:00080000:2.0:1788528776.256447:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].10, 224 off10112 00000100:00100000:3.0:1788528776.256456:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000040:00080000:2.0:1788528776.256468:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].11, 128 off10240 00000100:00100000:2.0:1788528776.256502:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3ff0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735627520:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788528776.256518:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719789440 00000100:00100000:1.0:1788528776.256523:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719789440 00000100:00100000:2.0:1788528776.256567:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528776.256609:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c5ade540 going to sleep for 11 seconds 00000100:00100000:3.0:1788528776.256652:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735627520 00000100:00100000:3.0:1788528776.256664:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735627520 00000100:00100000:1.0:1788528776.256676:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 33 00000100:00100000:1.0:1788528776.256688:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86b97e15-e0df-43d0-a2df-10bdbaf02f48+8:18711:x1875407719789440:12345-192.168.203.38@tcp:36:lfs.0 00010000:00010000:1.0:1788528776.256732:0:22707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788528776.256755:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b200/0x892c60dda91c9a8a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0352 expref: 8 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.256772:0:22707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8a8fc1fab700) 00010000:00010000:1.0:1788528776.256778:0:22707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788528776.256796:0:22707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551c00/0x892c60dda91c9abb lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.257154:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551c00/0x892c60dda91c9abb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.257206:0:22707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551c00/0x892c60dda91c9abb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528776.257226:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788528776.257238:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c4003c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+26:22702:x1875407735627520:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788528776.257374:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c4003c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07f6b94a-1259-41bf-8282-a67e1c8aef03+26:22702:x1875407735627520:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 138us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528776.257383:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000004:00010000:1.0:1788528776.257451:0:22707:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003d5fb86e reply state 00000000b902a498 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551c00/0x892c60dda91c9abb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528776.257456:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3ff0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735627520:0@lo:502:ll_cfg_requeue.0 00010000:00010000:1.0:1788528776.257472:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551c00/0x892c60dda91c9abb lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.257479:0:22707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8a8fc1fab700) 00010000:00010000:1.0:1788528776.257483:0:22707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1788528776.257485:0:22707:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788528776.257492:0:22707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000040:00080000:2.0:1788528776.257521:0:22702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].12, 224 off10464 00000040:00080000:2.0:1788528776.257531:0:22702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000100:00100000:1.0:1788528776.258346:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86b97e15-e0df-43d0-a2df-10bdbaf02f48+9:18711:x1875407719789440:12345-192.168.203.38@tcp:36:lfs.0 Request processed in 1659us (1901us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1788528776.258355:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 33 00000040:00080000:2.0:1788528776.261206:0:25750:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2e:0x0] index 64768 count 13 00000020:01000000:1.0:1788528776.261615:0:22702:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788528776.261632:0:22702:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788528776.261644:0:22702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c1551e00/0x892c60dda91c9a9f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9ab4 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.261656:0:22702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c1551e00/0x892c60dda91c9a9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9ab4 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788528776.261667:0:22702:0:(mgc_request.c:714:do_requeue()) updating log params 10000000:01000000:1.0:1788528776.261670:0:22702:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff8a90ff704000 from 13 10000000:01000000:1.0:1788528776.261673:0:22702:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788528776.261718:0:22702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c1550200/0x892c60dda91c9ac2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.261726:0:22702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8a90c1550200/0x892c60dda91c9ac2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.261736:0:22702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8a90c1550200/0x892c60dda91c9ac2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528776.261761:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735627648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788528776.261831:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528776.261869:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c7849300 going to sleep for 11 seconds 00000100:00100000:0.0:1788528776.261949:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735627648 00000100:00100000:0.0:1788528776.261958:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735627648 00000100:00100000:0.0:1788528776.262002:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788528776.262011:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c4001050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+26:22702:x1875407735627648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788528776.262023:0:22699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528776.262035:0:22699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a90c0031e00/0x892c60dda91c9ac9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x892c60dda91c9ac2 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528776.262058:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a90c0031e00/0x892c60dda91c9ac9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x892c60dda91c9ac2 expref: 27 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528776.262068:0:22699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a90c0031e00/0x892c60dda91c9ac9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x892c60dda91c9ac2 expref: 27 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528776.262100:0:22699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0031e00, rc 0) 00000100:00100000:0.0:1788528776.262136:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c4001050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07f6b94a-1259-41bf-8282-a67e1c8aef03+27:22702:x1875407735627648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528776.262142:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788528776.262277:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735627648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788528776.262292:0:22702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8a90c1550200/0x892c60dda91c9ac2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9ac9 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.262301:0:22702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8a90c1550200/0x892c60dda91c9ac2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x892c60dda91c9ac9 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528776.262336:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735627776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788528776.262360:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528776.262392:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c7849300 going to sleep for 11 seconds 00000100:00100000:2.0:1788528776.262445:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735627776 00000100:00100000:2.0:1788528776.262456:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735627776 00000100:00100000:2.0:1788528776.262490:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788528776.262497:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c4000450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+27:22702:x1875407735627776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788528776.262638:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c4000450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+27:22702:x1875407735627776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528776.262646:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788528776.262751:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735627776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788528776.262777:0:22702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735627904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788528776.262824:0:22702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528776.262849:0:22702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c7849300 going to sleep for 11 seconds 00000100:00100000:2.0:1788528776.262890:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735627904 00000100:00100000:2.0:1788528776.262894:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735627904 00000100:00100000:2.0:1788528776.262922:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788528776.262928:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c4002050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+27:22702:x1875407735627904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788528776.263012:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c4002050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+27:22702:x1875407735627904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528776.263020:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788528776.263238:0:22702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07f6b94a-1259-41bf-8282-a67e1c8aef03:22702:1875407735627904:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788528776.265031:0:25751:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000100:00100000:3.0:1788528776.268290:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528776.268419:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719789696 00000100:00100000:0.0:1788528776.268429:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719789696 00000100:00100000:0.0:1788528776.268492:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 2 00000100:00100000:0.0:1788528776.268503:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c78fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86b97e15-e0df-43d0-a2df-10bdbaf02f48+9:18711:x1875407719789696:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:0.0:1788528776.268769:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c78fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86b97e15-e0df-43d0-a2df-10bdbaf02f48+10:18711:x1875407719789696:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 267us (488us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1788528776.268777:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 2 00000020:01000000:2.0:1788528776.269384:0:22702:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788528776.269398:0:22702:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788528776.269408:0:22702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8a90c1550200/0x892c60dda91c9ac2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9ac9 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528776.269419:0:22702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8a90c1550200/0x892c60dda91c9ac2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x892c60dda91c9ac9 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528776.271251:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528776.271326:0:25501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719789952 00000100:00100000:1.0:1788528776.271335:0:25501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719789952 00000100:00100000:1.0:1788528776.271391:0:25501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 34 00000100:00100000:1.0:1788528776.271401:0:25501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86b97e15-e0df-43d0-a2df-10bdbaf02f48+10:18711:x1875407719789952:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1788528776.271425:0:25501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528776.271445:0:25501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550600/0x892c60dda91c9ad0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c0360 expref: -99 pid: 25501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.271512:0:25501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551600/0x892c60dda91c9ad7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.271526:0:25501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551600/0x892c60dda91c9ad7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.271537:0:25501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551600/0x892c60dda91c9ad7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.271548:0:25501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550800/0x892c60dda91c9ade lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.271617:0:25501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550800/0x892c60dda91c9ade lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.271625:0:25501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550800/0x892c60dda91c9ade lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788528776.271725:0:25501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788528776.271792:0:25501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551600/0x892c60dda91c9ad7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.271829:0:25501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551600/0x892c60dda91c9ad7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.271836:0:25501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551600/0x892c60dda91c9ad7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.271842:0:25501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c1551600 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528776.271847:0:25501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551600/0x892c60dda91c9ad7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.271855:0:25501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551600/0x892c60dda91c9ad7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.271868:0:25501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a8fc264ea00) 00010000:00010000:1.0:1788528776.271871:0:25501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788528776.271876:0:25501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551600/0x892c60dda91c9ad7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.271882:0:25501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551600/0x892c60dda91c9ad7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.271893:0:25501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550800/0x892c60dda91c9ade lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.271899:0:25501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550800/0x892c60dda91c9ade lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.271905:0:25501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550800/0x892c60dda91c9ade lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.271910:0:25501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c1550800 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528776.271921:0:25501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550800/0x892c60dda91c9ade lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.271927:0:25501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550800/0x892c60dda91c9ade lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.271948:0:25501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8a8fc1fab000) 00010000:00010000:1.0:1788528776.271950:0:25501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788528776.271953:0:25501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550800/0x892c60dda91c9ade lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.271959:0:25501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550800/0x892c60dda91c9ade lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.271992:0:25501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550600/0x892c60dda91c9ad0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0360 expref: 12 pid: 25501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.272002:0:25501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a8fc264ea00) 00010000:00010000:1.0:1788528776.272004:0:25501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788528776.272008:0:25501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550600/0x892c60dda91c9ad0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0360 expref: 12 pid: 25501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.272018:0:25501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c1550600, rc 0) 00000100:00100000:1.0:1788528776.272069:0:25501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86b97e15-e0df-43d0-a2df-10bdbaf02f48+11:18711:x1875407719789952:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 669us (826us total) trans 12884901894 rc 301/301 00000100:00100000:1.0:1788528776.272076:0:25501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 34 00000100:00100000:1.0:1788528776.284806:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528776.284901:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719790080 00000100:00100000:2.0:1788528776.284911:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719790080 00000100:00100000:2.0:1788528776.284981:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 35 00000100:00100000:2.0:1788528776.284993:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86b97e15-e0df-43d0-a2df-10bdbaf02f48+11:18711:x1875407719790080:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1788528776.285017:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528776.285037:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dbc00/0x892c60dda91c9aec lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c0367 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528776.285153:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68da400/0x892c60dda91c9af3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528776.285168:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68da400/0x892c60dda91c9af3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528776.285180:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68da400/0x892c60dda91c9af3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788528776.285221:0:22706:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788528776.285225:0:22706:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788528776.285245:0:22706:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68da400/0x892c60dda91c9af3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528776.285273:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dbc00/0x892c60dda91c9aec lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0367 expref: 13 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528776.285292:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68da400/0x892c60dda91c9af3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0367 expref: 12 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528776.285300:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8a8fc1fab700) 00010000:00010000:2.0:1788528776.285303:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788528776.285307:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c68da400, rc 0) 00000100:00100000:2.0:1788528776.285367:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86b97e15-e0df-43d0-a2df-10bdbaf02f48+12:18711:x1875407719790080:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 377us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528776.285374:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 35 00000100:00100000:0.0:1788528776.290529:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528776.291345:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719790208 00000100:00100000:2.0:1788528776.291357:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719790208 00000100:00100000:2.0:1788528776.291431:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 3 00000100:00100000:2.0:1788528776.291442:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86b97e15-e0df-43d0-a2df-10bdbaf02f48+12:18711:x1875407719790208:12345-192.168.203.38@tcp:37:lfs.0 00000100:00100000:2.0:1788528776.301453:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86b97e15-e0df-43d0-a2df-10bdbaf02f48+12:18711:x1875407719790208:12345-192.168.203.38@tcp:37:lfs.0 Request processed in 10003us (10924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528776.301467:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 3 00000100:00100000:1.0:1788528776.309165:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528776.310852:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719790464 00000100:00100000:3.0:1788528776.310866:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719790464 00000100:00100000:3.0:1788528776.310945:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 4 00000100:00100000:3.0:1788528776.310956:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90d8111450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86b97e15-e0df-43d0-a2df-10bdbaf02f48+12:18711:x1875407719790464:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:3.0:1788528776.311195:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90d8111450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86b97e15-e0df-43d0-a2df-10bdbaf02f48+13:18711:x1875407719790464:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 241us (2041us total) trans 12884901895 rc 0/0 00000100:00100000:3.0:1788528776.311212:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 4 00000100:00100000:0.0:1788528776.382101:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528776.382231:0:25501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719790592 00000100:00100000:1.0:1788528776.382260:0:25501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719790592 00000100:00100000:1.0:1788528776.382676:0:25501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 36 00000100:00100000:1.0:1788528776.382691:0:25501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:333a2baa-d5e5-441e-8b53-5d69075ed300+11:18717:x1875407719790592:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:1.0:1788528776.382721:0:25501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528776.382748:0:25501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551600/0x892c60dda91c9afa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c036e expref: -99 pid: 25501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.382847:0:25501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550800/0x892c60dda91c9b01 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.382864:0:25501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550800/0x892c60dda91c9b01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.382877:0:25501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550800/0x892c60dda91c9b01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.382888:0:25501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550600/0x892c60dda91c9b08 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.382895:0:25501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550600/0x892c60dda91c9b08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.382901:0:25501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550600/0x892c60dda91c9b08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.383258:0:25501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17600/0x892c60dda91c9b0f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.383272:0:25501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17600/0x892c60dda91c9b0f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.383280:0:25501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17600/0x892c60dda91c9b0f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788528776.383487:0:25501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788528776.383492:0:25501:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788528776.383543:0:25501:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17600/0x892c60dda91c9b0f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.383594:0:25501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550800/0x892c60dda91c9b01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.383601:0:25501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550800/0x892c60dda91c9b01 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.383608:0:25501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550800/0x892c60dda91c9b01 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.383615:0:25501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c1550800 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528776.383620:0:25501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550800/0x892c60dda91c9b01 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.383628:0:25501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550800/0x892c60dda91c9b01 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.383642:0:25501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a8fc264ea00) 00010000:00010000:1.0:1788528776.383645:0:25501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788528776.383651:0:25501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550800/0x892c60dda91c9b01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.383658:0:25501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550800/0x892c60dda91c9b01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.383676:0:25501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550600/0x892c60dda91c9b08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.383693:0:25501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550600/0x892c60dda91c9b08 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.383699:0:25501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550600/0x892c60dda91c9b08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.383705:0:25501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c1550600 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528776.383708:0:25501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550600/0x892c60dda91c9b08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.383716:0:25501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550600/0x892c60dda91c9b08 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.383724:0:25501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8a8fc1fab000) 00010000:00010000:1.0:1788528776.383727:0:25501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788528776.383730:0:25501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550600/0x892c60dda91c9b08 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.383735:0:25501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1550600/0x892c60dda91c9b08 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.383771:0:25501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551600/0x892c60dda91c9afa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c036e expref: 13 pid: 25501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.383786:0:25501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17600/0x892c60dda91c9b0f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c036e expref: 12 pid: 25501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.383793:0:25501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8a8fc1fab700) 00010000:00010000:1.0:1788528776.383796:0:25501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788528776.383805:0:25501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6e17600, rc 0) 00000100:00100000:1.0:1788528776.383912:0:25501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:333a2baa-d5e5-441e-8b53-5d69075ed300+12:18717:x1875407719790592:12345-192.168.203.38@tcp:101:bash.0 Request processed in 1224us (1825us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528776.383920:0:25501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 36 00000100:00100000:3.0:1788528776.387264:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528776.387921:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719790720 00000100:00100000:2.0:1788528776.387947:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719790720 00000100:00100000:2.0:1788528776.388036:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:2.0:1788528776.388049:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:333a2baa-d5e5-441e-8b53-5d69075ed300+5:18717:x1875407719790720:12345-192.168.203.38@tcp:900:bash.0 00000100:00100000:2.0:1788528776.388177:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:333a2baa-d5e5-441e-8b53-5d69075ed300+5:18717:x1875407719790720:12345-192.168.203.38@tcp:900:bash.0 Request processed in 130us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528776.388187:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7 00010000:00010000:0.0:1788528776.390281:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788528776.391027:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528776.391284:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719790976 00000100:00100000:3.0:1788528776.391298:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719790976 00000100:00100000:3.0:1788528776.391378:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 37 00000100:00100000:3.0:1788528776.391391:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3ff0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:333a2baa-d5e5-441e-8b53-5d69075ed300+12:18717:x1875407719790976:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:3.0:1788528776.391418:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528776.391444:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c9b16 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c0375 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.391631:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b800/0x892c60dda91c9b1d lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.391668:0:22706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68da400/0x892c60dda91c9af3 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0367 expref: 12 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.391680:0:22706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b800/0x892c60dda91c9b1d lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.391728:0:22706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68da400/0x892c60dda91c9af3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0367 expref: 12 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.391744:0:22706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68da400/0x892c60dda91c9af3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0367 expref: 12 pid: 22706 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528776.391760:0:22706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc3e55180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22706:1875407735628032:192.168.203.38@tcp:104: 00000100:00100000:3.0:1788528776.391968:0:22706:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90f6ee4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788528776.395646:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528776.395774:0:22706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc3e55180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22706:1875407735628032:192.168.203.38@tcp:104: 00010000:00010000:3.0:1788528776.395821:0:22706:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b800/0x892c60dda91c9b1d lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528776.395967:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719791104 00000100:00100000:0.0:1788528776.395975:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719791104 00010000:00010000:0.0:1788528776.396025:0:22692:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68da400/0x892c60dda91c9af3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0367 expref: 13 pid: 22706 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528776.396071:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 16 00000100:00100000:0.0:1788528776.396084:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6bc8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86b97e15-e0df-43d0-a2df-10bdbaf02f48+13:2404:x1875407719791104:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788528776.396101:0:22692:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528776.396109:0:22692:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68da400/0x892c60dda91c9af3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0367 expref: 13 pid: 22706 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528776.396146:0:22692:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68da400/0x892c60dda91c9af3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0367 expref: 13 pid: 22706 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528776.396176:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68da400/0x892c60dda91c9af3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0367 expref: 13 pid: 22706 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528776.396195:0:22692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8a8fc1fab700) 00010000:00010000:0.0:1788528776.396201:0:22692:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b800/0x892c60dda91c9b1d lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528776.396213:0:22692:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b800/0x892c60dda91c9b1d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528776.396223:0:22692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b800/0x892c60dda91c9b1d lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528776.396294:0:22692:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528776.396545:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6bc8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86b97e15-e0df-43d0-a2df-10bdbaf02f48+12:2404:x1875407719791104:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 462us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528776.396595:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 16 00010000:00010000:3.0:1788528776.398141:0:22706:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b800/0x892c60dda91c9b1d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.398161:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b800/0x892c60dda91c9b1d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.398198:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c9b24 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.398213:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c9b24 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.398242:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c9b24 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.404075:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ae00/0x892c60dda91c9b2b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.404107:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ae00/0x892c60dda91c9b2b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.404121:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ae00/0x892c60dda91c9b2b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788528776.404136:0:22706:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788528776.404171:0:22706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b800/0x892c60dda91c9b1d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.404179:0:22706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b800/0x892c60dda91c9b1d lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.404186:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b800/0x892c60dda91c9b1d lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.404194:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3b800 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528776.404199:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b800/0x892c60dda91c9b1d lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.404207:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b800/0x892c60dda91c9b1d lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.404226:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8a8fc1fab700) 00010000:00010000:3.0:1788528776.404230:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528776.404254:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b800/0x892c60dda91c9b1d lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.404261:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b800/0x892c60dda91c9b1d lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788528776.404279:0:22706:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000009bf809d reply state 0000000070284013 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c9b24 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.404292:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c9b24 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.404298:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8a8fc1fa9500) 00010000:00010000:3.0:1788528776.404301:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788528776.404304:0:22706:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788528776.404361:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c9b16 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0375 expref: 15 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.404380:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ae00/0x892c60dda91c9b2b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0375 expref: 14 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.404388:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a8fc1fa9e00) 00010000:00010000:3.0:1788528776.404390:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1788528776.404392:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3ae00, rc 0) 00000100:00100000:3.0:1788528776.404500:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3ff0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:333a2baa-d5e5-441e-8b53-5d69075ed300+15:18717:x1875407719790976:12345-192.168.203.38@tcp:101:bash.0 Request processed in 13112us (13482us total) trans 12884901896 rc 0/0 00000100:00100000:3.0:1788528776.404511:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 37 00000100:00100000:2.0:1788528776.423957:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528776.424132:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719791232 00000100:00100000:3.0:1788528776.424150:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719791232 00000100:00100000:3.0:1788528776.424281:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 38 00000100:00100000:3.0:1788528776.424295:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+15:18717:x1875407719791232:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:3.0:1788528776.424351:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528776.424390:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c9b39 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c037c expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.424502:0:22705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b800/0x892c60dda91c9b40 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.424533:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b800/0x892c60dda91c9b40 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.424548:0:22705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b800/0x892c60dda91c9b40 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788528776.424656:0:22705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788528776.424661:0:22705:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788528776.424686:0:22705:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b800/0x892c60dda91c9b40 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.424698:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b800/0x892c60dda91c9b40 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.424732:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c9b39 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c037c expref: 17 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.424752:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b800/0x892c60dda91c9b40 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c037c expref: 16 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.424762:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a8fc1fa9e00) 00010000:00010000:3.0:1788528776.424766:0:22705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788528776.424770:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3b800, rc 0) 00000100:00100000:3.0:1788528776.424875:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+16:18717:x1875407719791232:12345-192.168.203.38@tcp:101:bash.0 Request processed in 583us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528776.424883:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 38 00000100:00100000:0.0:1788528776.431889:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528776.432008:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719791488 00000100:00100000:3.0:1788528776.432020:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719791488 00000100:00100000:3.0:1788528776.432093:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:3.0:1788528776.432106:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+16:18717:x1875407719791488:12345-192.168.203.38@tcp:35:bash.0 00000100:00100000:3.0:1788528776.432486:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+17:18717:x1875407719791488:12345-192.168.203.38@tcp:35:bash.0 Request processed in 380us (610us total) trans 12884901897 rc 0/0 00000100:00100000:3.0:1788528776.432495:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:2.0:1788528776.547091:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528776.547215:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719791744 00000100:00100000:1.0:1788528776.547229:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719791744 00000100:00100000:1.0:1788528776.547316:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 39 00000100:00100000:1.0:1788528776.547328:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90fe693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:333a2baa-d5e5-441e-8b53-5d69075ed300+17:18727:x1875407719791744:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1788528776.547373:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528776.547402:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16000/0x892c60dda91c9b47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c0383 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788528776.547551:0:22707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788528776.547742:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16000/0x892c60dda91c9b47 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0383 expref: 19 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.547760:0:22707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a8fc264ea00) 00010000:00010000:1.0:1788528776.547763:0:22707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788528776.547770:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16000/0x892c60dda91c9b47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0383 expref: 19 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.547786:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6e16000, rc 0) 00000100:00100000:1.0:1788528776.547882:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90fe693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:333a2baa-d5e5-441e-8b53-5d69075ed300+18:18727:x1875407719791744:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 557us (807us total) trans 12884901898 rc 301/301 00000100:00100000:1.0:1788528776.547891:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 39 00000100:00100000:0.0:1788528776.552415:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528776.552512:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719792000 00000100:00100000:3.0:1788528776.552533:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719792000 00000100:00100000:2.0:1788528776.553023:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:2.0:1788528776.553038:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+18:18727:x1875407719792000:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:2.0:1788528776.553361:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+19:18727:x1875407719792000:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 325us (959us total) trans 12884901899 rc 0/0 00000100:00100000:2.0:1788528776.553376:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:0.0:1788528776.675419:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528776.675533:0:25501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719792256 00000100:00100000:1.0:1788528776.675546:0:25501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719792256 00000100:00100000:1.0:1788528776.675675:0:25501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 40 00000100:00100000:1.0:1788528776.675697:0:25501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:333a2baa-d5e5-441e-8b53-5d69075ed300+19:18730:x1875407719792256:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1788528776.675721:0:25501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528776.675740:0:25501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16000/0x892c60dda91c9b55 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c038a expref: -99 pid: 25501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.676102:0:25501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16c00/0x892c60dda91c9b5c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.676117:0:25501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16c00/0x892c60dda91c9b5c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.676128:0:25501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16c00/0x892c60dda91c9b5c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788528776.676139:0:25501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788528776.676261:0:25501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16000/0x892c60dda91c9b55 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c038a expref: 22 pid: 25501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.676281:0:25501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16c00/0x892c60dda91c9b5c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c038a expref: 21 pid: 25501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528776.676289:0:25501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a8fc1fa9e00) 00010000:00010000:1.0:1788528776.676292:0:25501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788528776.676295:0:25501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6e16c00, rc 0) 00000100:00100000:1.0:1788528776.676364:0:25501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:333a2baa-d5e5-441e-8b53-5d69075ed300+21:18730:x1875407719792256:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 668us (961us total) trans 12884901900 rc 0/0 00000100:00100000:1.0:1788528776.676371:0:25501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 40 00000100:00100000:1.0:1788528776.692487:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528776.692533:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528776.692608:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719792384 00000100:00100000:3.0:1788528776.692624:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719792384 00000100:00100000:3.0:1788528776.692720:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 41 00000100:00100000:3.0:1788528776.692733:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:333a2baa-d5e5-441e-8b53-5d69075ed300+21:18730:x1875407719792384:12345-192.168.203.38@tcp:54:lfs.0 00010000:00010000:3.0:1788528776.692837:0:22707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c9b6a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.692859:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c9b6a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.692873:0:22707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c9b6a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.692918:0:22707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c9b6a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.692936:0:22707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c9b6a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.693278:0:22707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c9b6a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.693286:0:22707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3ba00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528776.693292:0:22707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c9b6a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.693302:0:22707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c9b6a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.693318:0:22707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a8fc1fa9e00) 00010000:00010000:3.0:1788528776.693322:0:22707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788528776.693328:0:22707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c9b6a lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.693337:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c9b6a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528776.693459:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:333a2baa-d5e5-441e-8b53-5d69075ed300+21:18730:x1875407719792384:12345-192.168.203.38@tcp:54:lfs.0 Request processed in 728us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528776.693469:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 41 00000100:00100000:0.0:1788528776.693591:0:22690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719792512 00000100:00100000:0.0:1788528776.693598:0:22690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719792512 00000100:00100000:0.0:1788528776.693658:0:22690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:0.0:1788528776.693668:0:22690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+21:2403:x1875407719792512:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788528776.693695:0:22690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528776.693715:0:22690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16c00/0x892c60dda91c9b5c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c038a expref: 21 pid: 25501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528776.693728:0:22690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a8fc1fa9e00) 00010000:00010000:0.0:1788528776.693731:0:22690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528776.693754:0:22690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+20:2403:x1875407719792512:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 89us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528776.693761:0:22690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:0.0:1788528776.696504:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528776.696799:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719792768 00000100:00100000:2.0:1788528776.696834:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719792768 00000100:00100000:2.0:1788528776.696906:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:2.0:1788528776.696919:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3c7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+20:18730:x1875407719792768:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:2.0:1788528776.697240:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3c7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+21:18730:x1875407719792768:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 322us (748us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1788528776.697249:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:1.0:1788528776.943208:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528776.954956:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719793024 00000100:00100000:3.0:1788528776.954974:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719793024 00000100:00100000:3.0:1788528776.955131:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 42 00000100:00100000:3.0:1788528776.955143:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+21:18761:x1875407719793024:12345-192.168.203.38@tcp:101:cat.0 00010000:00010000:3.0:1788528776.955169:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528776.955189:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c9b71 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c0391 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.955319:0:22705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b400/0x892c60dda91c9b78 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.955345:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b400/0x892c60dda91c9b78 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.955360:0:22705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b400/0x892c60dda91c9b78 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788528776.955371:0:22705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788528776.959118:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ba00/0x892c60dda91c9b71 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0391 expref: 24 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.959144:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b400/0x892c60dda91c9b78 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0391 expref: 23 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528776.959155:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a8fc1fa9e00) 00010000:00010000:3.0:1788528776.959158:0:22705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788528776.959163:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3b400, rc 0) 00000100:00100000:3.0:1788528776.959247:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+23:18761:x1875407719793024:12345-192.168.203.38@tcp:101:cat.0 Request processed in 4106us (16047us total) trans 12884901902 rc 0/0 00000100:00100000:3.0:1788528776.959256:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 42 00000040:00080000:0.0:1788528776.969003:0:22740:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788528776.969339:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528776.970971:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719793152 00000100:00100000:0.0:1788528776.970984:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719793152 00000100:00100000:0.0:1788528776.971062:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1 00000100:00100000:0.0:1788528776.971082:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:333a2baa-d5e5-441e-8b53-5d69075ed300+23:2405:x1875407719793152:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788528776.971096:0:22692:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788528776.971119:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b400/0x892c60dda91c9b78 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0391 expref: 23 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528776.971139:0:22692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a8fc1fa9e00) 00010000:00010000:0.0:1788528776.971145:0:22692:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528776.971208:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:333a2baa-d5e5-441e-8b53-5d69075ed300+22:2405:x1875407719793152:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 129us (1873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528776.971216:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1 00000100:00100000:2.0:1788528776.974451:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528776.975972:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719793408 00000100:00100000:0.0:1788528776.975988:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719793408 00000100:00100000:0.0:1788528776.976086:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 8 00000100:00100000:0.0:1788528776.976097:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9101352680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+22:18761:x1875407719793408:12345-192.168.203.38@tcp:35:cat.0 00000100:00100000:0.0:1788528776.976403:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9101352680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+23:18761:x1875407719793408:12345-192.168.203.38@tcp:35:cat.0 Request processed in 306us (1966us total) trans 12884901903 rc 0/0 00000100:00100000:0.0:1788528776.976411:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 8 00000040:00080000:1.0:1788528777.023356:0:23462:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788528777.062854:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528777.062975:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719793664 00000100:00100000:2.0:1788528777.062985:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719793664 00000100:00100000:2.0:1788528777.063074:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 43 00000100:00100000:2.0:1788528777.063087:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:333a2baa-d5e5-441e-8b53-5d69075ed300+23:18767:x1875407719793664:12345-192.168.203.38@tcp:101:dd.0 00000100:00080000:3.0:1788528777.063096:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788528777.063116:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528777.063145:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dbe00/0x892c60dda91c9b86 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c0398 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528777.063258:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68da200/0x892c60dda91c9b8d lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528777.063273:0:22706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ae00/0x892c60dda91c9b2b lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0375 expref: 24 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528777.063290:0:22706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b800/0x892c60dda91c9b40 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c037c expref: 24 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528777.063299:0:22706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68da200/0x892c60dda91c9b8d lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528777.063332:0:22706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b800/0x892c60dda91c9b40 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c037c expref: 24 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528777.063346:0:22706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b800/0x892c60dda91c9b40 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c037c expref: 24 pid: 22705 timeout: 746 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528777.063373:0:22706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9101353800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22706:1875407735628160:192.168.203.38@tcp:104: 00010000:00010000:2.0:1788528777.063484:0:22706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ae00/0x892c60dda91c9b2b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0375 expref: 24 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528777.063493:0:22706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ae00/0x892c60dda91c9b2b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0375 expref: 24 pid: 22706 timeout: 746 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528777.063502:0:22706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9101350700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22706:1875407735628288:192.168.203.38@tcp:104: 00000100:00100000:2.0:1788528777.063527:0:22706:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c5ade540 going to sleep for 11 seconds 00000100:00100000:1.0:1788528777.074612:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528777.074645:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528777.074842:0:22706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9101353800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22706:1875407735628160:192.168.203.38@tcp:104: 00000100:00100000:2.0:1788528777.074854:0:22706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9101350700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22706:1875407735628288:192.168.203.38@tcp:104: 00010000:00010000:2.0:1788528777.074881:0:22706:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68da200/0x892c60dda91c9b8d lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528777.075979:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719793792 00000100:00100000:3.0:1788528777.075990:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719793792 00010000:00010000:3.0:1788528777.076033:0:22691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b800/0x892c60dda91c9b40 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c037c expref: 25 pid: 22705 timeout: 746 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528777.076092:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719793920 00000100:00100000:3.0:1788528777.076096:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719793920 00010000:00010000:3.0:1788528777.076111:0:22691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ae00/0x892c60dda91c9b2b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0375 expref: 26 pid: 22706 timeout: 746 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528777.076213:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 17 00000100:00100000:2.0:1788528777.076225:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:333a2baa-d5e5-441e-8b53-5d69075ed300+26:2403:x1875407719793792:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788528777.076241:0:22692:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528777.076248:0:22692:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b800/0x892c60dda91c9b40 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c037c expref: 26 pid: 22705 timeout: 746 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528777.076260:0:22692:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b800/0x892c60dda91c9b40 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c037c expref: 26 pid: 22705 timeout: 746 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528777.076281:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3b800/0x892c60dda91c9b40 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c037c expref: 26 pid: 22705 timeout: 746 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528777.076304:0:22692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a8fc1fa9e00) 00010000:00010000:2.0:1788528777.076309:0:22692:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68da200/0x892c60dda91c9b8d lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528777.076317:0:22692:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68da200/0x892c60dda91c9b8d lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528777.076323:0:22692:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528777.076373:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:333a2baa-d5e5-441e-8b53-5d69075ed300+25:2403:x1875407719793792:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 150us (1770us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528777.076381:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 17 00000100:00100000:3.0:1788528777.076661:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 18 00000100:00100000:3.0:1788528777.076670:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e29850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:333a2baa-d5e5-441e-8b53-5d69075ed300+24:2403:x1875407719793920:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788528777.076678:0:22691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788528777.076684:0:22691:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ae00/0x892c60dda91c9b2b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0375 expref: 24 pid: 22706 timeout: 746 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528777.076693:0:22691:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ae00/0x892c60dda91c9b2b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0375 expref: 24 pid: 22706 timeout: 746 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528777.076706:0:22691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3ae00/0x892c60dda91c9b2b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0375 expref: 24 pid: 22706 timeout: 746 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528777.076716:0:22691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a8fc1fa9e00) 00010000:00010000:3.0:1788528777.076719:0:22691:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68da200/0x892c60dda91c9b8d lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528777.076727:0:22691:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68da200/0x892c60dda91c9b8d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528777.076735:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68da200/0x892c60dda91c9b8d lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528777.076764:0:22691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788528777.076785:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e29850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:333a2baa-d5e5-441e-8b53-5d69075ed300+23:2403:x1875407719793920:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 118us (2140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528777.076792:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 18 00010000:00010000:2.0:1788528777.077522:0:22706:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68da200/0x892c60dda91c9b8d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528777.077532:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68da200/0x892c60dda91c9b8d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788528777.077575:0:22706:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788528777.077731:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dbe00/0x892c60dda91c9b86 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0398 expref: 24 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528777.077750:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68da200/0x892c60dda91c9b8d lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c0398 expref: 23 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528777.077758:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a8fc1fa9e00) 00010000:00010000:2.0:1788528777.077761:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788528777.077763:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c68da200, rc 0) 00000100:00100000:2.0:1788528777.077819:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:333a2baa-d5e5-441e-8b53-5d69075ed300+23:18767:x1875407719793664:12345-192.168.203.38@tcp:101:dd.0 Request processed in 14736us (14975us total) trans 12884901904 rc 0/0 00000100:00100000:2.0:1788528777.077836:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 43 00000100:00100000:1.0:1788528777.091481:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528777.091577:0:25501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719794048 00000100:00100000:2.0:1788528777.091587:0:25501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719794048 00000100:00100000:2.0:1788528777.091648:0:25501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 44 00000100:00100000:2.0:1788528777.091659:0:25501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:333a2baa-d5e5-441e-8b53-5d69075ed300+23:18767:x1875407719794048:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:2.0:1788528777.091684:0:25501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528777.091705:0:25501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dbe00/0x892c60dda91c9b9b lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c039f expref: -99 pid: 25501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528777.091749:0:25501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68da600/0x892c60dda91c9ba2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528777.091766:0:25501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68da600/0x892c60dda91c9ba2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528777.091778:0:25501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68da600/0x892c60dda91c9ba2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528777.091914:0:25501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dbe00/0x892c60dda91c9b9b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c039f expref: 25 pid: 25501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528777.091933:0:25501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68da600/0x892c60dda91c9ba2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c039f expref: 24 pid: 25501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528777.091942:0:25501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a8fc1fa9e00) 00010000:00010000:2.0:1788528777.091945:0:25501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788528777.091949:0:25501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c68da600, rc 0) 00000100:00100000:2.0:1788528777.092017:0:25501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:333a2baa-d5e5-441e-8b53-5d69075ed300+24:18767:x1875407719794048:12345-192.168.203.38@tcp:101:dd.0 Request processed in 359us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528777.092030:0:25501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 44 00000100:00100000:3.0:1788528777.100739:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528777.101012:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719794304 00000100:00100000:1.0:1788528777.101021:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719794304 00000100:00100000:1.0:1788528777.101082:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 45 00000100:00100000:1.0:1788528777.101092:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:333a2baa-d5e5-441e-8b53-5d69075ed300+24:18767:x1875407719794304:12345-192.168.203.38@tcp:36:dd.0 00010000:00010000:1.0:1788528777.101309:0:22707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c9ba9 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528777.101328:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c9ba9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528777.101340:0:22707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c9ba9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788528777.101404:0:22707:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:1.0:1788528777.101428:0:22707:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b34c27c7 reply state 00000000b93deb9d transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c9ba9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528777.101441:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c9ba9 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528777.101448:0:22707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a8fc1fa9e00) 00010000:00010000:1.0:1788528777.101451:0:22707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788528777.101454:0:22707:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788528777.101550:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:333a2baa-d5e5-441e-8b53-5d69075ed300+27:18767:x1875407719794304:12345-192.168.203.38@tcp:36:dd.0 Request processed in 459us (819us total) trans 12884901906 rc 0/0 00000100:00100000:1.0:1788528777.101600:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 45 00000020:00080000:1.0:1788528777.101604:0:22707:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788528777.112135:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528777.112227:0:25501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719794432 00000100:00100000:2.0:1788528777.112237:0:25501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719794432 00000100:00100000:2.0:1788528777.112304:0:25501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 46 00000100:00100000:2.0:1788528777.112314:0:25501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:333a2baa-d5e5-441e-8b53-5d69075ed300+27:18767:x1875407719794432:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:2.0:1788528777.112338:0:25501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528777.112357:0:25501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dbe00/0x892c60dda91c9bb0 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c03a6 expref: -99 pid: 25501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528777.112415:0:25501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dbe00/0x892c60dda91c9bb0 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03a6 expref: 28 pid: 25501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528777.112430:0:25501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dbe00/0x892c60dda91c9bb0 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03a6 expref: 28 pid: 25501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528777.112447:0:25501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a8fc1fa9e00) 00010000:00010000:2.0:1788528777.112450:0:25501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788528777.112454:0:25501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c68dbe00, rc 0) 00000100:00100000:2.0:1788528777.112515:0:25501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:333a2baa-d5e5-441e-8b53-5d69075ed300+28:18767:x1875407719794432:12345-192.168.203.38@tcp:101:dd.0 Request processed in 203us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528777.112522:0:25501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 46 00000100:00100000:3.0:1788528777.144766:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528777.145049:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719794688 00000100:00100000:2.0:1788528777.145058:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719794688 00000100:00100000:2.0:1788528777.145123:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 2 00000100:00100000:2.0:1788528777.145133:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:333a2baa-d5e5-441e-8b53-5d69075ed300+28:18767:x1875407719794688:12345-192.168.203.38@tcp:103:dd.0 00010000:00010000:2.0:1788528777.145148:0:22692:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528777.145185:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dbe00/0x892c60dda91c9bb0 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03a6 expref: 28 pid: 25501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528777.145205:0:22692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a8fc1fa9e00) 00010000:00010000:2.0:1788528777.145211:0:22692:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528777.145268:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:333a2baa-d5e5-441e-8b53-5d69075ed300+27:18767:x1875407719794688:12345-192.168.203.38@tcp:103:dd.0 Request processed in 135us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528777.145276:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 2 00000100:00100000:0.0:1788528777.147612:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528777.147742:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719794816 00000100:00100000:1.0:1788528777.147753:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719794816 00000100:00100000:1.0:1788528777.147818:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 47 00000100:00100000:1.0:1788528777.147829:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:333a2baa-d5e5-441e-8b53-5d69075ed300+27:18767:x1875407719794816:12345-192.168.203.38@tcp:58:dd.0 00010000:00010000:1.0:1788528777.147960:0:22707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16e00/0x892c60dda91c9bb7 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528777.147978:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16e00/0x892c60dda91c9bb7 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528777.147991:0:22707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16e00/0x892c60dda91c9bb7 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788528777.154419:0:22707:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788528777.154460:0:22707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:1.0:1788528777.154683:0:22707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:1.0:1788528777.155128:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:333a2baa-d5e5-441e-8b53-5d69075ed300+27:18767:x1875407719794816:12345-192.168.203.38@tcp:58:dd.0 Request processed in 7295us (7519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528777.155139:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 47 00000100:00100000:1.0:1788528777.172399:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528777.173032:0:25501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719794944 00000100:00100000:2.0:1788528777.173054:0:25501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719794944 00000100:00100000:2.0:1788528777.173115:0:25501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 48 00000100:00100000:2.0:1788528777.173125:0:25501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:333a2baa-d5e5-441e-8b53-5d69075ed300+27:18767:x1875407719794944:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:2.0:1788528777.173145:0:25501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528777.173163:0:25501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dbe00/0x892c60dda91c9bbe lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c03ad expref: -99 pid: 25501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528777.173226:0:25501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16e00/0x892c60dda91c9bb7 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528777.173237:0:25501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dbe00/0x892c60dda91c9bbe lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03ad expref: 28 pid: 25501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528777.173256:0:25501:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16e00/0x892c60dda91c9bb7 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528777.173268:0:25501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dbe00/0x892c60dda91c9bbe lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03ad expref: 28 pid: 25501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528777.173280:0:25501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a8fc1fa9e00) 00010000:00010000:2.0:1788528777.173294:0:25501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788528777.173298:0:25501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dbe00/0x892c60dda91c9bbe lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03ad expref: 28 pid: 25501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528777.173306:0:25501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c68dbe00, rc 0) 00000100:00100000:2.0:1788528777.173369:0:25501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:333a2baa-d5e5-441e-8b53-5d69075ed300+28:18767:x1875407719794944:12345-192.168.203.38@tcp:101:dd.0 Request processed in 245us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528777.173377:0:25501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 48 00010000:00010000:1.0:1788528777.406808:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788528777.921522:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735628416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788528777.921581:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9101350700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735628544:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788528777.921650:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528777.921674:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528777.921701:0:24215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735628416 00000100:00100000:2.0:1788528777.921708:0:24215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735628416 00000100:00100000:2.0:1788528777.921775:0:24215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735628544 00000100:00100000:2.0:1788528777.921778:0:24215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735628544 00000100:00100000:2.0:1788528777.921803:0:24215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788528777.921812:0:24215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735628416:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788528777.921826:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1788528777.921841:0:24215:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528777.921902:0:24215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735628416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528777.921909:0:24215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788528777.921928:0:24215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788528777.921934:0:24215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9101353800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735628544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788528777.921943:0:24215:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788528777.921971:0:24215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9101353800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875407735628544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528777.921977:0:24215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788528777.922015:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9101350700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1875407735628544:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788528777.922858:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07f6b94a-1259-41bf-8282-a67e1c8aef03:3638:1875407735628672:0@lo:400:kworker.0 00000100:00100000:2.0:1788528777.922903:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528777.922945:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735629184:0@lo:400:kworker.0 00000100:00100000:2.0:1788528777.923004:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528777.923032:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1875407735629696:0@lo:400:kworker.0 00000100:00100000:2.0:1788528777.923056:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528777.923075:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735630208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788528777.923095:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528777.923116:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788528777.923122:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875407735629056:0@lo:400:kworker.0 00000100:00100000:2.0:1788528777.923144:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528777.923161:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735629568:0@lo:400:kworker.0 00000100:00100000:2.0:1788528777.923181:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528777.923411:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735629184 00000100:00100000:1.0:1788528777.923418:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735629184 00000100:00100000:1.0:1788528777.923458:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788528777.923466:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9101350700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735629184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528777.923531:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9101350700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735629184:12345-0@lo:400:kworker.0 Request processed in 65us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528777.923538:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788528777.923588:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735629696 00000100:00100000:1.0:1788528777.923592:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735629696 00000100:00100000:1.0:1788528777.923631:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735629056 00000100:00100000:1.0:1788528777.923634:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735629056 00000100:00100000:1.0:1788528777.923646:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735629568 00000100:00100000:1.0:1788528777.923649:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735629568 00000100:00100000:1.0:1788528777.923682:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788528777.923688:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9101353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875407735629696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528777.923721:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9101353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875407735629696:12345-0@lo:400:kworker.0 Request processed in 33us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528777.923727:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788528777.923740:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788528777.923745:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9101353100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875407735629056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528777.923771:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9101353100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875407735629056:12345-0@lo:400:kworker.0 Request processed in 26us (626us total) trans 0 rc 0/0 00000100:00080000:3.0:1788528777.923777:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788528777.923777:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1788528777.923782:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788528777.923789:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788528777.923794:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9101353b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875407735629568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528777.923806:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735628928:0@lo:400:kworker.0 00000100:00100000:2.0:1788528777.924024:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735630080:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788528777.924072:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9101353b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875407735629568:12345-0@lo:400:kworker.0 Request processed in 277us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528777.924078:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788528777.924124:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735628800:0@lo:400:kworker.0 00000100:00100000:1.0:1788528777.924154:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528777.924184:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735629312:0@lo:400:kworker.0 00000100:00100000:1.0:1788528777.924225:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528777.924245:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1875407735629824:0@lo:400:kworker.0 00000100:00100000:1.0:1788528777.924268:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528777.924297:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735629824 00000100:00100000:1.0:1788528777.924301:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735629824 00000100:00100000:1.0:1788528777.924327:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788528777.924333:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875407735629824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528777.924368:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875407735629824:12345-0@lo:400:kworker.0 Request processed in 35us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528777.924374:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788528777.924404:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1875407735629824:0@lo:400:kworker.0 00000100:00100000:1.0:1788528777.924515:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735628800 00000100:00100000:1.0:1788528777.924519:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735628800 00000100:00100000:1.0:1788528777.924546:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788528777.924574:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735628800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528777.925071:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875407735628800:12345-0@lo:400:kworker.0 Request processed in 61us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528777.925084:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788528777.925126:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1875407735628800:0@lo:400:kworker.0 00000100:00100000:1.0:1788528777.925148:0:24215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735630208 00000100:00100000:1.0:1788528777.925153:0:24215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735630208 00000100:00100000:1.0:1788528777.925185:0:24215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788528777.925193:0:24215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9101350380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735630208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788528777.925498:0:24215:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915845632 avail 3684323328 00000100:00100000:1.0:1788528777.925544:0:24215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9101350380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735630208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 351us (2446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528777.925589:0:24215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788528777.925641:0:24214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735629312 00000100:00100000:1.0:1788528777.925646:0:24214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735629312 00000100:00100000:1.0:1788528777.925675:0:24214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788528777.925682:0:24214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735629312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788528777.925728:0:24214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875407735629312:12345-0@lo:400:kworker.0 Request processed in 46us (1502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528777.925734:0:24214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788528777.925759:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1875407735629312:0@lo:400:kworker.0 00000100:00080000:1.0:1788528777.925791:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788528777.925807:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788528777.925897:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735628672 00000100:00100000:0.0:1788528777.925902:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735628672 00000100:00100000:0.0:1788528777.925942:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788528777.925950:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c4003050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+27:3638:x1875407735628672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528777.925983:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c4003050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07f6b94a-1259-41bf-8282-a67e1c8aef03+27:3638:x1875407735628672:12345-0@lo:400:kworker.0 Request processed in 35us (3080us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528777.926002:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788528777.932527:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528777.932634:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735629440:0@lo:400:kworker.0 00000100:00100000:3.0:1788528777.932667:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528777.932686:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1875407735629952:0@lo:400:kworker.0 00000100:00100000:3.0:1788528777.932706:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788528777.932752:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735628416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788528777.932794:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735629440 00000100:00100000:3.0:1788528777.932812:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735629440 00000100:00100000:3.0:1788528777.932860:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735629952 00000100:00100000:3.0:1788528777.932863:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735629952 00000100:00100000:3.0:1788528777.932919:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788528777.932928:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6bc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735629440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528777.932979:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6bc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875407735629440:12345-0@lo:400:kworker.0 Request processed in 52us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528777.932993:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788528777.933011:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788528777.933017:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c78fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875407735629952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788528777.933061:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c78fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875407735629952:12345-0@lo:400:kworker.0 Request processed in 44us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528777.933067:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1788528777.933084:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788528777.933118:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875407735629440:0@lo:400:kworker.0 00010000:00080000:3.0:1788528777.933130:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f58c3800 x1875407735629952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788528777.933140:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1875407735629952:0@lo:400:kworker.0 00000100:00100000:1.0:1788528777.935643:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528777.935689:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528777.935744:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719795072 00000100:00100000:3.0:1788528777.935753:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719795072 00000100:00100000:3.0:1788528777.935813:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 181 00000100:00100000:3.0:1788528777.935833:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c4002c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+14:2403:x1875407719795072:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1788528777.935897:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c4002c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:225d6bb0-f0a8-4a99-b4cb-e50f5c0aab60+14:2403:x1875407719795072:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 75us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528777.935905:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 181 00000100:00100000:2.0:1788528777.936993:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788528777.937062:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07f6b94a-1259-41bf-8282-a67e1c8aef03:3638:1875407735628672:0@lo:400:kworker.0 00000100:00100000:2.0:1788528777.937078:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735629184:0@lo:400:kworker.0 00010000:00080000:2.0:1788528777.937090:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a90f58c0000 x1875407735629696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788528793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788528777.937101:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1875407735629696:0@lo:400:kworker.0 00000100:00100000:2.0:1788528777.937121:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735630208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788528777.937152:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875407735629056:0@lo:400:kworker.0 00000100:00100000:2.0:1788528777.937182:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1875407735629568:0@lo:400:kworker.0 00000100:00100000:3.0:1788528777.937511:0:24795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735630080 00000100:00100000:3.0:1788528777.937518:0:24795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735630080 00000100:00100000:3.0:1788528777.937582:0:24795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788528777.937592:0:24795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9101351880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735630080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788528777.937610:0:24795:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915845632 avail 3684323328 00000100:00100000:3.0:1788528777.937650:0:24795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9101351880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875407735630080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528777.937663:0:24795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788528777.938350:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1875407735630080:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788528777.940869:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528777.940908:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528777.941058:0:24212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735628928 00000100:00100000:0.0:1788528777.941070:0:24212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735628928 00000100:00100000:0.0:1788528777.941147:0:24794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719795328 00000100:00100000:0.0:1788528777.941152:0:24794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719795328 00000100:00100000:0.0:1788528777.941202:0:24794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788528777.941213:0:24794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90ffa6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735628928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788528777.941289:0:24794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90ffa6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735628928:12345-0@lo:400:kworker.0 Request processed in 79us (8769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528777.941296:0:24794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788528777.941313:0:24794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 16 00000100:00100000:0.0:1788528777.941321:0:24794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:333a2baa-d5e5-441e-8b53-5d69075ed300+5:2403:x1875407719795328:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1788528777.941364:0:24794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:333a2baa-d5e5-441e-8b53-5d69075ed300+5:2403:x1875407719795328:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 44us (5674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528777.941388:0:24794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 16 00000100:00080000:0.0:1788528777.941407:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788528777.941521:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719795584 00000100:00100000:2.0:1788528777.941526:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719795584 00000100:00100000:2.0:1788528777.941575:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 55 00000100:00100000:2.0:1788528777.941582:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86b97e15-e0df-43d0-a2df-10bdbaf02f48+12:2403:x1875407719795584:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1788528777.941627:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86b97e15-e0df-43d0-a2df-10bdbaf02f48+12:2403:x1875407719795584:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 46us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528777.941960:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735628928:0@lo:400:kworker.0 00000100:00100000:2.0:1788528777.942490:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 55 00000100:00100000:1.0:1788528777.944405:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528777.944447:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528777.944483:0:24794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719795840 00000100:00100000:1.0:1788528777.944492:0:24794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719795840 00000100:00100000:1.0:1788528777.944542:0:24794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719795456 00000100:00100000:1.0:1788528777.944545:0:24794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719795456 00000100:00100000:1.0:1788528777.944589:0:24794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 17 00000100:00100000:1.0:1788528777.944599:0:24794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86b97e15-e0df-43d0-a2df-10bdbaf02f48+5:2403:x1875407719795840:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528777.944667:0:24794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86b97e15-e0df-43d0-a2df-10bdbaf02f48+5:2403:x1875407719795840:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 69us (3758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528777.944675:0:24794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 17 00000100:00100000:1.0:1788528777.944705:0:24794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 18 00000100:00100000:1.0:1788528777.944712:0:24794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:333a2baa-d5e5-441e-8b53-5d69075ed300+5:2403:x1875407719795456:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528777.944739:0:24794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:333a2baa-d5e5-441e-8b53-5d69075ed300+5:2403:x1875407719795456:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 28us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528777.944745:0:24794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 18 00000100:00080000:1.0:1788528777.944775:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788528777.944779:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788528777.944831:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528777.944888:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528777.944981:0:24794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719795968 00000100:00100000:1.0:1788528777.944985:0:24794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719795968 00000100:00100000:1.0:1788528777.945011:0:24794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00100000:1.0:1788528777.945017:0:24794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86b97e15-e0df-43d0-a2df-10bdbaf02f48+5:2403:x1875407719795968:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528777.945048:0:24794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86b97e15-e0df-43d0-a2df-10bdbaf02f48+5:2403:x1875407719795968:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 31us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528777.945054:0:24794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00080000:1.0:1788528777.945102:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788528777.945133:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719795200 00000100:00100000:1.0:1788528777.945137:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719795200 00000100:00080000:1.0:1788528777.945152:0:22701:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788528777.945187:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719795712 00000100:00100000:1.0:1788528777.945190:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719795712 00000100:00100000:1.0:1788528777.945205:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 56 00000100:00100000:1.0:1788528777.945212:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+5:2403:x1875407719795200:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528777.945243:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+5:2403:x1875407719795200:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 31us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528777.945249:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 56 00000100:00100000:1.0:1788528777.945289:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 57 00000100:00100000:1.0:1788528777.945297:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86b97e15-e0df-43d0-a2df-10bdbaf02f48+5:2403:x1875407719795712:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1788528777.945324:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86b97e15-e0df-43d0-a2df-10bdbaf02f48+5:2403:x1875407719795712:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 28us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528777.945330:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 57 00000040:00080000:0.0:1788528777.982916:0:22740:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788528777.982926:0:22740:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788528777.982968:0:22740:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1788528777.982977:0:22740:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788528777.983110:0:22740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c2a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22740:1875407735630336:192.168.203.38@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788528777.983324:0:22740:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90de3eb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788528777.995736:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528777.996647:0:22740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c2a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22740:1875407735630336:192.168.203.38@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788528777.997296:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719796096 00000100:00100000:3.0:1788528777.997310:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719796096 00000100:00100000:3.0:1788528777.997405:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 49 00000100:00100000:3.0:1788528777.997420:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+28:18768:x1875407719796096:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788528777.997468:0:22705:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788528777.999503:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+28:18768:x1875407719796096:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 Request processed in 2070us (3766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528777.999627:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 49 00000100:00100000:1.0:1788528778.012354:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528778.012498:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719796224 00000100:00100000:2.0:1788528778.012517:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719796224 00000100:00100000:2.0:1788528778.012623:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 50 00000100:00100000:2.0:1788528778.012636:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:333a2baa-d5e5-441e-8b53-5d69075ed300+28:18768:x1875407719796224:12345-192.168.203.38@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788528778.012758:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68daa00/0x892c60dda91c9bc5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.012926:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68daa00/0x892c60dda91c9bc5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.012948:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68daa00/0x892c60dda91c9bc5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.012971:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db200/0x892c60dda91c9bcc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.013051:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db200/0x892c60dda91c9bcc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.013083:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db200/0x892c60dda91c9bcc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.013118:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dae00/0x892c60dda91c9bd3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.013129:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dae00/0x892c60dda91c9bd3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.013137:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dae00/0x892c60dda91c9bd3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788528778.013205:0:22706:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788528778.013211:0:22706:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788528778.013232:0:22706:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dae00/0x892c60dda91c9bd3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.013246:0:22706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68daa00/0x892c60dda91c9bc5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.013252:0:22706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68daa00/0x892c60dda91c9bc5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.013260:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68daa00/0x892c60dda91c9bc5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.013266:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c68daa00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528778.013271:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68daa00/0x892c60dda91c9bc5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.013279:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68daa00/0x892c60dda91c9bc5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.013300:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a8fc1fa9f00) 00010000:00010000:2.0:1788528778.013304:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528778.013310:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68daa00/0x892c60dda91c9bc5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.013317:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68daa00/0x892c60dda91c9bc5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.013334:0:22706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db200/0x892c60dda91c9bcc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.013341:0:22706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db200/0x892c60dda91c9bcc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.013347:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db200/0x892c60dda91c9bcc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.013353:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c68db200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528778.013357:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db200/0x892c60dda91c9bcc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.013363:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db200/0x892c60dda91c9bcc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.013371:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff8a8fc3770400) 00010000:00010000:2.0:1788528778.013373:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528778.013376:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db200/0x892c60dda91c9bcc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.013381:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db200/0x892c60dda91c9bcc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.013411:0:22706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dae00/0x892c60dda91c9bd3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.013418:0:22706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dae00/0x892c60dda91c9bd3 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.013423:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dae00/0x892c60dda91c9bd3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.013429:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c68dae00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528778.013432:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dae00/0x892c60dda91c9bd3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.013438:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dae00/0x892c60dda91c9bd3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.013446:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a8fc1fa9e00) 00010000:00010000:2.0:1788528778.013449:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528778.013452:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dae00/0x892c60dda91c9bd3 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.013458:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dae00/0x892c60dda91c9bd3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528778.016009:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:333a2baa-d5e5-441e-8b53-5d69075ed300+28:18768:x1875407719796224:12345-192.168.203.38@tcp:34:lhsmtool_posix.0 Request processed in 3356us (3652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528778.016027:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 50 00000100:00100000:1.0:1788528778.024409:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528778.024634:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719796480 00000100:00100000:2.0:1788528778.024650:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719796480 00000100:00100000:2.0:1788528778.024741:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 51 00000100:00100000:2.0:1788528778.025692:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:333a2baa-d5e5-441e-8b53-5d69075ed300+28:18768:x1875407719796480:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788528778.025722:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528778.025752:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dae00/0x892c60dda91c9bda lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c03b4 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.026148:0:22707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db200/0x892c60dda91c9be1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.026169:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db200/0x892c60dda91c9be1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.026184:0:22707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db200/0x892c60dda91c9be1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788528778.026201:0:22707:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788528778.026309:0:22707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db200/0x892c60dda91c9be1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.026319:0:22707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db200/0x892c60dda91c9be1 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.026327:0:22707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db200/0x892c60dda91c9be1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.026334:0:22707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c68db200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528778.026339:0:22707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db200/0x892c60dda91c9be1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.026348:0:22707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db200/0x892c60dda91c9be1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.026362:0:22707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a8fc1fa9e00) 00010000:00010000:2.0:1788528778.026379:0:22707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788528778.026385:0:22707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db200/0x892c60dda91c9be1 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.026393:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db200/0x892c60dda91c9be1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.026449:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dae00/0x892c60dda91c9bda lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03b4 expref: 30 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.026461:0:22707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a8fc1fa9f00) 00010000:00010000:2.0:1788528778.026463:0:22707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788528778.026467:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dae00/0x892c60dda91c9bda lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03b4 expref: 30 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.026477:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c68dae00, rc 0) 00000100:00100000:2.0:1788528778.026636:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:333a2baa-d5e5-441e-8b53-5d69075ed300+29:18768:x1875407719796480:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 956us (2244us total) trans 12884901907 rc 301/301 00000100:00100000:0.0:1788528778.031931:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528778.032365:0:25501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719796608 00000100:00100000:3.0:1788528778.032378:0:25501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719796608 00000100:00100000:2.0:1788528778.037609:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 51 00000100:00100000:3.0:1788528778.038794:0:25501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 52 00000100:00100000:3.0:1788528778.038830:0:25501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:333a2baa-d5e5-441e-8b53-5d69075ed300+29:18768:x1875407719796608:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788528778.038879:0:25501:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788528778.039416:0:25501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:333a2baa-d5e5-441e-8b53-5d69075ed300+29:18768:x1875407719796608:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 Request processed in 598us (7513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528778.039426:0:25501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 52 00000100:00100000:3.0:1788528778.055085:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528778.066781:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719796864 00000100:00100000:0.0:1788528778.066814:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719796864 00000100:00100000:0.0:1788528778.066938:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 53 00000100:00100000:0.0:1788528778.066952:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90c78fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+29:18768:x1875407719796864:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788528778.066982:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528778.067012:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030c00/0x892c60dda91c9bef lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c03bb expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788528778.075308:0:22705:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x23:0x0], count =31 00000004:00080000:0.0:1788528778.075327:0:22705:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x23:0x0]+31 in llog 00000004:00080000:0.0:1788528778.075355:0:22705:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:0.0:1788528778.075892:0:22705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c9bf6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528778.075909:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c9bf6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528778.075934:0:22705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c9bf6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528778.076108:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030c00/0x892c60dda91c9bef lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03bb expref: 32 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528778.076131:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c9bf6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03bb expref: 31 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528778.076140:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a8fc264ef00) 00010000:00010000:0.0:1788528778.076143:0:22705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788528778.076147:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0031400, rc 0) 00000100:00100000:0.0:1788528778.076296:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90c78fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+31:18768:x1875407719796864:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 9347us (21228us total) trans 12884901908 rc 0/0 00000100:00100000:0.0:1788528778.076305:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 53 00000100:00100000:1.0:1788528778.087855:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528778.087984:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719797120 00000100:00100000:2.0:1788528778.087994:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719797120 00000100:00100000:2.0:1788528778.088065:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 54 00000100:00100000:2.0:1788528778.088075:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:333a2baa-d5e5-441e-8b53-5d69075ed300+31:18768:x1875407719797120:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788528778.088131:0:22706:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528778.088157:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0031400/0x892c60dda91c9bf6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03bb expref: 31 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.088176:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a8fc264ef00) 00010000:00010000:2.0:1788528778.088201:0:22706:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788528778.088227:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dae00/0x892c60dda91c9c04 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.088241:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dae00/0x892c60dda91c9c04 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.088251:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dae00/0x892c60dda91c9c04 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.088265:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db200/0x892c60dda91c9c0b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x7f2fcc61 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.088272:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db200/0x892c60dda91c9c0b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x7f2fcc61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.088277:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db200/0x892c60dda91c9c0b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x7f2fcc61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.088330:0:22706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dae00/0x892c60dda91c9c04 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.088338:0:22706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dae00/0x892c60dda91c9c04 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.088346:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dae00/0x892c60dda91c9c04 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.088353:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c68dae00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528778.088357:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dae00/0x892c60dda91c9c04 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.088365:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dae00/0x892c60dda91c9c04 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.088380:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8a8fc1fab700) 00010000:00010000:2.0:1788528778.088382:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528778.088387:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dae00/0x892c60dda91c9c04 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.088393:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dae00/0x892c60dda91c9c04 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.088715:0:22706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db200/0x892c60dda91c9c0b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x7f2fcc61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.088722:0:22706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db200/0x892c60dda91c9c0b lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x7f2fcc61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.088728:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db200/0x892c60dda91c9c0b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x7f2fcc61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.088734:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c68db200 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528778.088737:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db200/0x892c60dda91c9c0b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x7f2fcc61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.088742:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db200/0x892c60dda91c9c0b lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x7f2fcc61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.088750:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x7f2fcc61 (ffff8a8fc3770400) 00010000:00010000:2.0:1788528778.088752:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528778.088755:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db200/0x892c60dda91c9c0b lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x7f2fcc61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.088761:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db200/0x892c60dda91c9c0b lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x7f2fcc61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528778.088866:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:333a2baa-d5e5-441e-8b53-5d69075ed300+30:18768:x1875407719797120:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 Request processed in 791us (1023us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788528778.088874:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 54 00000100:00100000:1.0:1788528778.097423:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528778.097864:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719797248 00000100:00100000:2.0:1788528778.097881:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719797248 00000100:00100000:2.0:1788528778.097948:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 55 00000100:00100000:2.0:1788528778.097959:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:333a2baa-d5e5-441e-8b53-5d69075ed300+30:18768:x1875407719797248:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788528778.097980:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528778.098005:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68daa00/0x892c60dda91c9c12 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c03c2 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.098045:0:22707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db000/0x892c60dda91c9c19 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.098059:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db000/0x892c60dda91c9c19 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.098070:0:22707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db000/0x892c60dda91c9c19 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.098190:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68daa00/0x892c60dda91c9c12 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03c2 expref: 32 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.098209:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db000/0x892c60dda91c9c19 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03c2 expref: 31 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.098219:0:22707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a8fc3770600) 00010000:00010000:2.0:1788528778.098228:0:22707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788528778.098233:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c68db000, rc 0) 00000100:00100000:2.0:1788528778.098305:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:333a2baa-d5e5-441e-8b53-5d69075ed300+31:18768:x1875407719797248:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 347us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528778.098311:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 55 00000100:00100000:3.0:1788528778.100957:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528778.101115:0:25501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719797504 00000100:00100000:0.0:1788528778.101127:0:25501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719797504 00000100:00100000:0.0:1788528778.101199:0:25501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 56 00000100:00100000:0.0:1788528778.101209:0:25501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:333a2baa-d5e5-441e-8b53-5d69075ed300+31:18768:x1875407719797504:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788528778.101303:0:25501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030c00/0x892c60dda91c9c20 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528778.101329:0:25501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030c00/0x892c60dda91c9c20 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528778.101340:0:25501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030c00/0x892c60dda91c9c20 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788528778.101548:0:25501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:0.0:1788528778.101597:0:25501:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 647319042661ns, next at 648319039844ns, rc = 0 00000004:00010000:0.0:1788528778.101888:0:25501:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000efa240c0 reply state 00000000ef781841 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030c00/0x892c60dda91c9c20 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528778.101901:0:25501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030c00/0x892c60dda91c9c20 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528778.101908:0:25501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a8fc3770600) 00010000:00010000:0.0:1788528778.101911:0:25501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788528778.101915:0:25501:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788528778.102033:0:25501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:333a2baa-d5e5-441e-8b53-5d69075ed300+33:18768:x1875407719797504:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 Request processed in 824us (1088us total) trans 12884901909 rc 0/0 00000100:00100000:0.0:1788528778.102042:0:25501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 56 00000100:00100000:1.0:1788528778.120886:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528778.121018:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719797632 00000100:00100000:2.0:1788528778.121032:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719797632 00000100:00100000:2.0:1788528778.121118:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 57 00000100:00100000:2.0:1788528778.121131:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:333a2baa-d5e5-441e-8b53-5d69075ed300+33:18768:x1875407719797632:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788528778.121165:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528778.121194:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68daa00/0x892c60dda91c9c27 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c03c9 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.121276:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68daa00/0x892c60dda91c9c27 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03c9 expref: 34 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.121293:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68daa00/0x892c60dda91c9c27 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03c9 expref: 34 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.121317:0:22707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a8fc3770600) 00010000:00010000:2.0:1788528778.121321:0:22707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788528778.121327:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c68daa00, rc 0) 00000100:00100000:2.0:1788528778.121411:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:333a2baa-d5e5-441e-8b53-5d69075ed300+34:18768:x1875407719797632:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 282us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528778.121419:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 57 00000100:00100000:1.0:1788528778.130734:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528778.130986:0:24794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719797760 00000100:00100000:2.0:1788528778.131001:0:24794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719797760 00000100:00100000:2.0:1788528778.131105:0:24794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 20 00000100:00100000:2.0:1788528778.131119:0:24794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:333a2baa-d5e5-441e-8b53-5d69075ed300+5:2403:x1875407719797760:12345-192.168.203.38@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788528778.132208:0:24794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:333a2baa-d5e5-441e-8b53-5d69075ed300+6:2403:x1875407719797760:12345-192.168.203.38@tcp:2:lhsmtool_posix.0 Request processed in 1084us (1480us total) trans 12884901891 rc 0/0 00000100:00100000:2.0:1788528778.132221:0:24794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 20 00000100:00100000:3.0:1788528778.157824:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528778.162156:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719798016 00000100:00100000:0.0:1788528778.162178:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719798016 00000100:00100000:2.0:1788528778.168832:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:2.0:1788528778.168854:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:333a2baa-d5e5-441e-8b53-5d69075ed300+34:18768:x1875407719798016:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788528778.169404:0:22708:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:1.0:1788528778.169418:0:22708:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:2.0:1788528778.171433:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:333a2baa-d5e5-441e-8b53-5d69075ed300+35:18768:x1875407719798016:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 Request processed in 2573us (13609us total) trans 12884901910 rc 0/0 00000100:00100000:2.0:1788528778.171450:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:1.0:1788528778.186143:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528778.189732:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719798272 00000100:00100000:2.0:1788528778.189753:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719798272 00000100:00100000:2.0:1788528778.189934:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 58 00000100:00100000:2.0:1788528778.189947:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:333a2baa-d5e5-441e-8b53-5d69075ed300+35:18768:x1875407719798272:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788528778.190113:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:333a2baa-d5e5-441e-8b53-5d69075ed300+35:18768:x1875407719798272:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 Request processed in 168us (3984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528778.190122:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 58 00000100:00100000:3.0:1788528778.193606:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528778.200473:0:25501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719798400 00000100:00100000:0.0:1788528778.200496:0:25501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719798400 00000100:00100000:2.0:1788528778.201947:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 59 00000100:00100000:2.0:1788528778.201966:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:333a2baa-d5e5-441e-8b53-5d69075ed300+35:18768:x1875407719798400:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788528778.201994:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788528778.202023:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db200/0x892c60dda91c9c2e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c03d0 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.202116:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dae00/0x892c60dda91c9c35 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.202152:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dae00/0x892c60dda91c9c35 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.202167:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dae00/0x892c60dda91c9c35 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788528778.202228:0:22706:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788528778.202255:0:22706:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dae00/0x892c60dda91c9c35 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.202289:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db200/0x892c60dda91c9c2e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03d0 expref: 37 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.202326:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dae00/0x892c60dda91c9c35 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03d0 expref: 36 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.202338:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a8fc3770600) 00010000:00010000:2.0:1788528778.202342:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788528778.202347:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c68dae00, rc 0) 00000100:00100000:2.0:1788528778.202435:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:333a2baa-d5e5-441e-8b53-5d69075ed300+36:18768:x1875407719798400:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 474us (8891us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528778.202444:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 59 00000100:00100000:3.0:1788528778.209704:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528778.210031:0:24213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719798528 00000100:00100000:0.0:1788528778.210045:0:24213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719798528 00000100:00100000:0.0:1788528778.210124:0:24213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 21 00000100:00100000:0.0:1788528778.210137:0:24213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:333a2baa-d5e5-441e-8b53-5d69075ed300+6:2404:x1875407719798528:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788528778.210161:0:24213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788528778.210187:0:24213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000acd1bc08/0x892c60dda91c9c3c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c03d7 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788528778.210220:0:24213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ac88a, blocks: 0x0 00010000:00010000:0.0:1788528778.210244:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=647s v=(0 0) 00010000:00010000:0.0:1788528778.210265:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788528778.210278:0:24213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acd1bc08/0x892c60dda91c9c3c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03d7 expref: 7 pid: 24213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528778.210303:0:24213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000acd1bc08/0x892c60dda91c9c3c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03d7 expref: 7 pid: 24213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528778.210333:0:24213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90c0031a00, rc 0) 00000100:00100000:0.0:1788528778.210405:0:24213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:333a2baa-d5e5-441e-8b53-5d69075ed300+7:2404:x1875407719798528:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 271us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528778.210413:0:24213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 21 00000100:00100000:2.0:1788528778.213695:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528778.213762:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719798784 00000100:00100000:0.0:1788528778.213777:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719798784 00000100:00100000:0.0:1788528778.213861:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 60 00000100:00100000:0.0:1788528778.213876:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9101351c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+36:18768:x1875407719798784:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788528778.214098:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9101351c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+36:18768:x1875407719798784:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 Request processed in 225us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528778.214107:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 60 00000100:00100000:3.0:1788528778.219691:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528778.221734:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719798912 00000100:00100000:2.0:1788528778.221757:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719798912 00000100:00100000:2.0:1788528778.221853:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 61 00000100:00100000:2.0:1788528778.221866:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:333a2baa-d5e5-441e-8b53-5d69075ed300+36:18768:x1875407719798912:12345-192.168.203.38@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788528778.233268:0:22685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:2.0:1788528778.233297:0:22685:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788528778.233344:0:22685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000100:00100000:0.0:1788528778.233586:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788528778.233606:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735630464:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788528778.233667:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528778.233710:0:25104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735630464 00000100:00100000:0.0:1788528778.233716:0:25104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735630464 00000100:00100000:0.0:1788528778.233757:0:25104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788528778.233765:0:25104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3640:x1875407735630464:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788528778.233899:0:25104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788528778.233910:0:25104:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788528778.233913:0:25104:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788528778.233914:0:25104:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1788528778 -> 1788528778 00002000:00010000:0.0:1788528778.233917:0:25104:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788528778.233958:0:25104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3640:x1875407735630464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 193us (290us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1788528778.233965:0:25104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:0.0:1788528778.234010:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a90f58c3100/2, rc 0, transno 12884901892 00000100:00100000:0.0:1788528778.234016:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1875407735630464:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788528778.234110:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:333a2baa-d5e5-441e-8b53-5d69075ed300+19:18768:x1875407719798912:12345-192.168.203.38@tcp:44:lhsmtool_posix.0 Request processed in 12247us (14445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528778.234120:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 61 00010000:00010000:3.0:1788528778.234391:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551800/0x892c60dda91c9a3d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528778.234411:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551800/0x892c60dda91c9a3d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528778.234418:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551800/0x892c60dda91c9a3d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528778.234424:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c1551800 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528778.234428:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551800/0x892c60dda91c9a3d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528778.234436:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551800/0x892c60dda91c9a3d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528778.234450:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8a8fc1fab000) 00010000:00010000:3.0:1788528778.234453:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528778.234458:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551800/0x892c60dda91c9a3d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528778.234463:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551800/0x892c60dda91c9a3d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528778.234482:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551a00/0x892c60dda91c9a44 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528778.234487:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551a00/0x892c60dda91c9a44 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528778.234492:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551a00/0x892c60dda91c9a44 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528778.234496:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c1551a00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528778.234504:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551a00/0x892c60dda91c9a44 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528778.234608:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551a00/0x892c60dda91c9a44 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528778.234618:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8a8fc1fab700) 00010000:00010000:3.0:1788528778.234620:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528778.234624:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551a00/0x892c60dda91c9a44 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528778.234630:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551a00/0x892c60dda91c9a44 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528778.234642:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c9b24 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528778.234648:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c9b24 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528778.234654:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c9b24 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528778.234659:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6f3a000 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528778.234662:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c9b24 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528778.234668:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c9b24 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528778.234675:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8a8fc1fa9500) 00010000:00010000:3.0:1788528778.234677:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528778.234686:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c9b24 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528778.234692:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6f3a000/0x892c60dda91c9b24 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528778.234707:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c9ba9 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528778.234713:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c9ba9 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528778.234718:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c9ba9 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528778.234723:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e17c00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528778.234726:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c9ba9 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528778.234732:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c9ba9 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528778.234739:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a8fc1fa9e00) 00010000:00010000:3.0:1788528778.234741:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788528778.234744:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c9ba9 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528778.234749:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17c00/0x892c60dda91c9ba9 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528778.234757:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030c00/0x892c60dda91c9c20 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528778.234772:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030c00/0x892c60dda91c9c20 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528778.234777:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030c00/0x892c60dda91c9c20 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528778.234781:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0030c00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:3.0:1788528778.234783:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030c00/0x892c60dda91c9c20 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528778.234789:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030c00/0x892c60dda91c9c20 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528778.234806:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a8fc3770600) 00010000:00010000:3.0:1788528778.234809:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788528778.234811:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030c00/0x892c60dda91c9c20 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528778.234816:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c0030c00/0x892c60dda91c9c20 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528778.240003:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551c00/0x892c60dda91c9abb lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528778.240028:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551c00/0x892c60dda91c9abb lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528778.240037:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551c00/0x892c60dda91c9abb lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528778.240045:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c1551c00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:1.0:1788528778.240051:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551c00/0x892c60dda91c9abb lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528778.240071:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551c00/0x892c60dda91c9abb lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528778.240106:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8a8fc1fab700) 00010000:00010000:1.0:1788528778.240110:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788528778.240117:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551c00/0x892c60dda91c9abb lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528778.240124:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c1551c00/0x892c60dda91c9abb lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528778.241774:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528778.241952:0:24794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719799040 00000100:00100000:2.0:1788528778.241963:0:24794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719799040 00000100:00100000:2.0:1788528778.242022:0:24794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23 00000100:00100000:2.0:1788528778.242032:0:24794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:333a2baa-d5e5-441e-8b53-5d69075ed300+7:2404:x1875407719799040:12345-192.168.203.38@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788528778.242148:0:24794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:333a2baa-d5e5-441e-8b53-5d69075ed300+7:2404:x1875407719799040:12345-192.168.203.38@tcp:16:lhsmtool_posix.0 Request processed in 117us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528778.242156:0:24794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23 00000100:00100000:0.0:1788528778.248396:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528778.251912:0:25501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719799296 00000100:00100000:3.0:1788528778.251926:0:25501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719799296 00000100:00100000:2.0:1788528778.262922:0:25501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 62 00000100:00100000:2.0:1788528778.262946:0:25501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:333a2baa-d5e5-441e-8b53-5d69075ed300+15:18768:x1875407719799296:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788528778.263006:0:25501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528778.263036:0:25501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dae00/0x892c60dda91c9c35 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03d0 expref: 15 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.263057:0:25501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a8fc3770600) 00010000:00010000:2.0:1788528778.263063:0:25501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788528778.263094:0:25501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db200/0x892c60dda91c9c43 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.263108:0:25501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db200/0x892c60dda91c9c43 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.263118:0:25501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db200/0x892c60dda91c9c43 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788528778.263251:0:25501:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce239696 reply state 0000000058d3b73d transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db200/0x892c60dda91c9c43 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.263285:0:25501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68db200/0x892c60dda91c9c43 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.263291:0:25501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a8fc3770600) 00010000:00010000:2.0:1788528778.263294:0:25501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788528778.263297:0:25501:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788528778.263407:0:25501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:333a2baa-d5e5-441e-8b53-5d69075ed300+16:18768:x1875407719799296:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 Request processed in 471us (15020us total) trans 12884901911 rc 0/0 00000100:00100000:2.0:1788528778.263415:0:25501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 62 00000100:00100000:0.0:1788528778.268051:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528778.268249:0:24212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719799424 00000100:00100000:3.0:1788528778.268260:0:24212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719799424 00000100:00100000:3.0:1788528778.268321:0:24212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 24 00000100:00100000:3.0:1788528778.268331:0:24212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f0019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+7:18768:x1875407719799424:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788528778.268349:0:24212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788528778.268367:0:24212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006fe1b0e3/0x892c60dda91c9c4a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c03de expref: -99 pid: 24212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528778.268420:0:24212:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000acd1bc08/0x892c60dda91c9c3c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03d7 expref: 8 pid: 24213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528778.268430:0:24212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528778.268435:0:24212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788528778.268440:0:24212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fe1b0e3/0x892c60dda91c9c4a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03de expref: 8 pid: 24212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528778.268479:0:24212:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000acd1bc08/0x892c60dda91c9c3c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03d7 expref: 8 pid: 24213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528778.268494:0:24212:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000acd1bc08/0x892c60dda91c9c3c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03d7 expref: 8 pid: 24213 timeout: 747 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528778.268507:0:24212:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f09f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:24212:1875407735630592:192.168.203.38@tcp:104: 00000100:00100000:3.0:1788528778.268864:0:24212:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c8d936c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788528778.277207:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528778.277361:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719799552 00000100:00100000:2.0:1788528778.277375:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719799552 00010000:00010000:2.0:1788528778.277440:0:22743:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000acd1bc08/0x892c60dda91c9c3c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03d7 expref: 9 pid: 24213 timeout: 747 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528778.277485:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00100000:2.0:1788528778.277496:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:333a2baa-d5e5-441e-8b53-5d69075ed300+9:2404:x1875407719799552:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788528778.277514:0:22743:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528778.277537:0:22743:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000acd1bc08/0x892c60dda91c9c3c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03d7 expref: 9 pid: 24213 timeout: 747 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.277571:0:22743:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000acd1bc08/0x892c60dda91c9c3c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03d7 expref: 9 pid: 24213 timeout: 747 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.277600:0:22743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528778.277605:0:22743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528778.277613:0:22743:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006fe1b0e3/0x892c60dda91c9c4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03de expref: 9 pid: 24212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.277637:0:22743:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fe1b0e3/0x892c60dda91c9c4a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03de expref: 9 pid: 24212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.277679:0:22743:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006fe1b0e3/0x892c60dda91c9c4a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03de expref: 9 pid: 24212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528778.277693:0:22743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9101352300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:22743:1875407735630720:192.168.203.38@tcp:105: 00000100:00100000:2.0:1788528778.277782:0:22743:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a8fc3ded180 going to sleep for 11 seconds 00010000:00010000:3.0:1788528778.283520:0:24212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000acd1bc08/0x892c60dda91c9c3c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03d7 expref: 9 pid: 24213 timeout: 747 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788528778.283601:0:24212:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f09f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:24212:1875407735630592:192.168.203.38@tcp:104: 00010000:00010000:3.0:1788528778.283647:0:24212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006fe1b0e3/0x892c60dda91c9c4a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03de expref: 8 pid: 24212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788528778.285095:0:24212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6f3a000, rc 0) 00000100:00100000:3.0:1788528778.285190:0:24212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f0019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+8:18768:x1875407719799424:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 16857us (17145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528778.285201:0:24212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 24 00000100:00100000:2.0:1788528778.290738:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528778.290883:0:24214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719799680 00000100:00100000:1.0:1788528778.290902:0:24214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719799680 00000100:00100000:0.0:1788528778.291158:0:22743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9101352300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:22743:1875407735630720:192.168.203.38@tcp:105: 00010000:00010000:0.0:1788528778.291185:0:22743:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788528778.291247:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:333a2baa-d5e5-441e-8b53-5d69075ed300+8:2404:x1875407719799552:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 13753us (14054us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528778.291258:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00100000:1.0:1788528778.291356:0:24214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 25 00000100:00100000:1.0:1788528778.291370:0:24214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9101350000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:333a2baa-d5e5-441e-8b53-5d69075ed300+7:2404:x1875407719799680:12345-192.168.203.38@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788528778.291624:0:24214:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788528778.291629:0:24214:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1788528777 00002000:00010000:1.0:1788528778.291632:0:24214:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1788528776 00002000:00010000:1.0:1788528778.291634:0:24214:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1788528778 -> 1788528777 00002000:00010000:1.0:1788528778.291636:0:24214:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788528778.296205:0:24214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9101350000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:333a2baa-d5e5-441e-8b53-5d69075ed300+8:2404:x1875407719799680:12345-192.168.203.38@tcp:2:lhsmtool_posix.0 Request processed in 4817us (5457us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1788528778.296226:0:24214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 25 00000100:00100000:2.0:1788528778.299632:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1788528778.300395:0:24213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719799808 00000100:00100000:0.0:1788528778.300406:0:24213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719799808 00000100:00100000:0.0:1788528778.300550:0:24213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 26 00000100:00100000:0.0:1788528778.300595:0:24213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9101350a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:333a2baa-d5e5-441e-8b53-5d69075ed300+8:2404:x1875407719799808:12345-192.168.203.38@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788528778.300654:0:24213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000054738cc3/0x892c60dda91c9c51 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528778.300698:0:24213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006fe1b0e3/0x892c60dda91c9c4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03de expref: 8 pid: 24212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528778.300708:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788528778.300712:0:24213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788528778.300717:0:24213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054738cc3/0x892c60dda91c9c51 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528778.300767:0:24213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006fe1b0e3/0x892c60dda91c9c4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03de expref: 8 pid: 24212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528778.300782:0:24213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006fe1b0e3/0x892c60dda91c9c4a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03de expref: 8 pid: 24212 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528778.300824:0:24213:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:24213:1875407735630848:192.168.203.38@tcp:104: 00000100:00100000:0.0:1788528778.300920:0:24213:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90de3eb840 going to sleep for 11 seconds 00000100:00100000:0.0:1788528778.319882:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528778.320110:0:24213:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:24213:1875407735630848:192.168.203.38@tcp:104: 00010000:00010000:1.0:1788528778.320155:0:24213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000054738cc3/0x892c60dda91c9c51 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528778.321924:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719799936 00000100:00100000:2.0:1788528778.321938:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719799936 00010000:00010000:2.0:1788528778.321984:0:22692:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006fe1b0e3/0x892c60dda91c9c4a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03de expref: 9 pid: 24212 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528778.322078:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 20 00000100:00100000:2.0:1788528778.322095:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:333a2baa-d5e5-441e-8b53-5d69075ed300+9:2404:x1875407719799936:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788528778.322111:0:22692:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528778.322149:0:22692:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006fe1b0e3/0x892c60dda91c9c4a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03de expref: 9 pid: 24212 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.322163:0:22692:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006fe1b0e3/0x892c60dda91c9c4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03de expref: 9 pid: 24212 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.322343:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fe1b0e3/0x892c60dda91c9c4a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03de expref: 9 pid: 24212 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.322361:0:22692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788528778.322366:0:22692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788528778.322373:0:22692:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000054738cc3/0x892c60dda91c9c51 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.322383:0:22692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054738cc3/0x892c60dda91c9c51 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.322420:0:22692:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528778.322488:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:333a2baa-d5e5-441e-8b53-5d69075ed300+8:2404:x1875407719799936:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 402us (2616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528778.322496:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 20 00010000:00010000:1.0:1788528778.322705:0:24213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000054738cc3/0x892c60dda91c9c51 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528778.322715:0:24213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054738cc3/0x892c60dda91c9c51 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528778.322736:0:24213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000054738cc3/0x892c60dda91c9c51 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528778.322744:0:24213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054738cc3/0x892c60dda91c9c51 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528778.322751:0:24213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054738cc3/0x892c60dda91c9c51 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528778.322758:0:24213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0030600 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:1.0:1788528778.322763:0:24213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054738cc3/0x892c60dda91c9c51 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528778.322772:0:24213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054738cc3/0x892c60dda91c9c51 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528778.322787:0:24213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054738cc3/0x892c60dda91c9c51 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528778.322824:0:24213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054738cc3/0x892c60dda91c9c51 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528778.322877:0:24213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9101350a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:333a2baa-d5e5-441e-8b53-5d69075ed300+7:2404:x1875407719799808:12345-192.168.203.38@tcp:1:lhsmtool_posix.0 Request processed in 22286us (23331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528778.322885:0:24213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 26 00000100:00100000:0.0:1788528778.326183:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528778.326398:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719800192 00000100:00100000:1.0:1788528778.326409:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719800192 00000100:00100000:1.0:1788528778.326520:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 63 00000100:00100000:1.0:1788528778.326532:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:333a2baa-d5e5-441e-8b53-5d69075ed300+16:18768:x1875407719800192:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788528778.326676:0:22707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16400/0x892c60dda91c9c58 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528778.326696:0:22707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68da600/0x892c60dda91c9ba2 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c039f expref: 16 pid: 25501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528778.326706:0:22707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16400/0x892c60dda91c9c58 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528778.326738:0:22707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68da600/0x892c60dda91c9ba2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c039f expref: 16 pid: 25501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528778.326753:0:22707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68da600/0x892c60dda91c9ba2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c039f expref: 16 pid: 25501 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528778.326769:0:22707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22707:1875407735630976:192.168.203.38@tcp:104: 00000100:00100000:1.0:1788528778.326886:0:22707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c7849e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788528778.338446:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528778.338986:0:22707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22707:1875407735630976:192.168.203.38@tcp:104: 00010000:00010000:1.0:1788528778.339015:0:22707:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16400/0x892c60dda91c9c58 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528778.343612:0:22690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719800320 00000100:00100000:2.0:1788528778.343626:0:22690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719800320 00010000:00010000:2.0:1788528778.343682:0:22690:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68da600/0x892c60dda91c9ba2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c039f expref: 17 pid: 25501 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528778.343748:0:22690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 21 00000100:00100000:2.0:1788528778.343758:0:22690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+17:2403:x1875407719800320:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788528778.343771:0:22690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528778.343777:0:22690:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68da600/0x892c60dda91c9ba2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c039f expref: 17 pid: 25501 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.345782:0:22690:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68da600/0x892c60dda91c9ba2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c039f expref: 17 pid: 25501 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.345831:0:22690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68da600/0x892c60dda91c9ba2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c039f expref: 17 pid: 25501 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.345850:0:22690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a8fc1fa9e00) 00010000:00010000:2.0:1788528778.345857:0:22690:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dbe00/0x892c60dda91c9bbe lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03ad expref: 16 pid: 25501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.345868:0:22690:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16400/0x892c60dda91c9c58 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.345876:0:22690:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16400/0x892c60dda91c9c58 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.345883:0:22690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16400/0x892c60dda91c9c58 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.346133:0:22690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528778.346265:0:22690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+16:2403:x1875407719800320:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 2506us (7828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528778.346276:0:22690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 21 00010000:00010000:1.0:1788528778.348542:0:22707:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16400/0x892c60dda91c9c58 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528778.348585:0:22707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16400/0x892c60dda91c9c58 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528778.348891:0:22707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16c00/0x892c60dda91c9c5f lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528778.348908:0:22707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68daa00/0x892c60dda91c9c27 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03c9 expref: 16 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528778.349250:0:22707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16c00/0x892c60dda91c9c5f lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528778.349293:0:22707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68daa00/0x892c60dda91c9c27 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03c9 expref: 16 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528778.349308:0:22707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68daa00/0x892c60dda91c9c27 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03c9 expref: 16 pid: 22707 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528778.349691:0:22707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22707:1875407735631104:192.168.203.38@tcp:104: 00000100:00100000:1.0:1788528778.349786:0:22707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c7849480 going to sleep for 11 seconds 00000100:00100000:0.0:1788528778.360298:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528778.360603:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719800448 00000100:00100000:2.0:1788528778.360613:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719800448 00010000:00010000:2.0:1788528778.360654:0:22691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68daa00/0x892c60dda91c9c27 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03c9 expref: 17 pid: 22707 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528778.360720:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 22 00000100:00100000:2.0:1788528778.360730:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:333a2baa-d5e5-441e-8b53-5d69075ed300+17:2404:x1875407719800448:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788528778.360746:0:22691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788528778.360753:0:22691:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68daa00/0x892c60dda91c9c27 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03c9 expref: 17 pid: 22707 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.360765:0:22691:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68daa00/0x892c60dda91c9c27 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03c9 expref: 17 pid: 22707 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.360787:0:22691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a8fc3770600) 00010000:00010000:2.0:1788528778.360804:0:22691:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16c00/0x892c60dda91c9c5f lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.360992:0:22691:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16c00/0x892c60dda91c9c5f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.361002:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16c00/0x892c60dda91c9c5f lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.361024:0:22691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788528778.361084:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:333a2baa-d5e5-441e-8b53-5d69075ed300+17:2404:x1875407719800448:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 355us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788528778.361136:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 22 00010000:00010000:1.0:1788528778.361467:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68daa00/0x892c60dda91c9c27 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03c9 expref: 16 pid: 22707 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788528778.361491:0:22707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22707:1875407735631104:192.168.203.38@tcp:104: 00010000:00010000:1.0:1788528778.361512:0:22707:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16c00/0x892c60dda91c9c5f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528778.361521:0:22707:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16c00/0x892c60dda91c9c5f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528778.361528:0:22707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16c00/0x892c60dda91c9c5f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788528778.361686:0:22707:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:1.0:1788528778.361810:0:22707:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:1.0:1788528778.369079:0:22707:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:1.0:1788528778.369241:0:22707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a8fc44c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22707:1875407735631232:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788528778.369337:0:22707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788528778.369365:0:22707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c78499c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788528778.369594:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735631232 00000100:00100000:0.0:1788528778.369602:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735631232 00000100:00100000:0.0:1788528778.369650:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788528778.369659:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc44c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22707:x1875407735631232:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788528778.369742:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc44c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22707:x1875407735631232:12345-0@lo:1000:mdt00_002.0 Request processed in 83us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528778.369762:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788528778.369818:0:22707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a8fc44c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22707:1875407735631232:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1788528778.369968:0:22707:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:0.0:1788528778.370012:0:22707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22707:1875407735631360:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788528778.370044:0:22707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528778.370062:0:22707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90de3eb540 going to sleep for 11 seconds 00000100:00100000:0.0:1788528778.370075:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735631360 00000100:00100000:0.0:1788528778.370079:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735631360 00000100:00100000:0.0:1788528778.370120:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788528778.370127:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f58c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22707:x1875407735631360:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788528778.370240:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:22707:x1875407735631360:12345-0@lo:1000:mdt00_002.0 Request processed in 113us (195us total) trans 12884901894 rc 0/0 00000100:00100000:0.0:1788528778.370248:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788528778.370280:0:22707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22707:1875407735631360:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1788528778.370315:0:22707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16c00/0x892c60dda91c9c5f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528778.370326:0:22707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16c00/0x892c60dda91c9c5f lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528778.370333:0:22707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16c00/0x892c60dda91c9c5f lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528778.370339:0:22707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e16c00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528778.370343:0:22707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16c00/0x892c60dda91c9c5f lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528778.370351:0:22707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16c00/0x892c60dda91c9c5f lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528778.370679:0:22707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a8fc3770600) 00010000:00010000:0.0:1788528778.370683:0:22707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788528778.370689:0:22707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16c00/0x892c60dda91c9c5f lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528778.370696:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16c00/0x892c60dda91c9c5f lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528778.370728:0:22707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16e00/0x892c60dda91c9bb7 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528778.370735:0:22707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16e00/0x892c60dda91c9bb7 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528778.370740:0:22707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16e00/0x892c60dda91c9bb7 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528778.370745:0:22707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e16e00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:0.0:1788528778.370748:0:22707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16e00/0x892c60dda91c9bb7 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528778.370754:0:22707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16e00/0x892c60dda91c9bb7 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528778.370762:0:22707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a8fc1fa9e00) 00010000:00010000:0.0:1788528778.370765:0:22707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788528778.370771:0:22707:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dbe00/0x892c60dda91c9bbe lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03ad expref: 19 pid: 25501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528778.370784:0:22707:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dbe00/0x892c60dda91c9bbe lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03ad expref: 19 pid: 25501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528778.370813:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dbe00/0x892c60dda91c9bbe lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03ad expref: 19 pid: 25501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528778.370842:0:22707:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68dbe00/0x892c60dda91c9bbe lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03ad expref: 19 pid: 25501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788528778.370854:0:22707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22707:1875407735631488:192.168.203.38@tcp:105: 00000100:00100000:0.0:1788528778.370921:0:22707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a90c96fea80 going to sleep for 11 seconds 00000100:00100000:0.0:1788528778.377308:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528778.377385:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719800576 00000100:00100000:1.0:1788528778.377395:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719800576 00000100:00100000:1.0:1788528778.377456:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:1.0:1788528778.377466:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a8fc3732c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:333a2baa-d5e5-441e-8b53-5d69075ed300+20:18767:x1875407719800576:12345-192.168.203.38@tcp:49:dd.0 00000100:00100000:1.0:1788528778.377618:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a8fc3732c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:333a2baa-d5e5-441e-8b53-5d69075ed300+20:18767:x1875407719800576:12345-192.168.203.38@tcp:49:dd.0 Request processed in 153us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528778.377625:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:3.0:1788528778.380837:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528778.380922:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719800704 00000100:00100000:1.0:1788528778.380932:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719800704 00000100:00100000:1.0:1788528778.380992:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 64 00000100:00100000:1.0:1788528778.381003:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+20:18767:x1875407719800704:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:1.0:1788528778.381037:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788528778.381057:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16000/0x892c60dda91c9c66 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbe4619e99f7c03e5 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528778.381112:0:22705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17400/0x892c60dda91c9c6d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528778.381125:0:22705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16400/0x892c60dda91c9c58 lrc: 2/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528778.381133:0:22705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17400/0x892c60dda91c9c6d lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528778.381150:0:22705:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16400/0x892c60dda91c9c58 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528778.381161:0:22705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17400/0x892c60dda91c9c6d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528778.382408:0:22707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22707:1875407735631488:192.168.203.38@tcp:105: 00010000:00010000:2.0:1788528778.382440:0:22707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16e00/0x892c60dda91c9bb7 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.382466:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16e00/0x892c60dda91c9bb7 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.382499:0:22707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68daa00/0x892c60dda91c9c74 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.382511:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68daa00/0x892c60dda91c9c74 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.382522:0:22707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68daa00/0x892c60dda91c9c74 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.382532:0:22707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68daa00/0x892c60dda91c9c74 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.382537:0:22707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68daa00/0x892c60dda91c9c74 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.382543:0:22707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68daa00/0x892c60dda91c9c74 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.382549:0:22707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c68daa00 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528778.382577:0:22707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68daa00/0x892c60dda91c9c74 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.382585:0:22707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68daa00/0x892c60dda91c9c74 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.382596:0:22707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a8fc1fa9e00) 00010000:00010000:2.0:1788528778.382599:0:22707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788528778.382603:0:22707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68daa00/0x892c60dda91c9c74 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.382615:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90c68daa00/0x892c60dda91c9c74 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.382625:0:22707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16400/0x892c60dda91c9c58 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.382631:0:22707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16400/0x892c60dda91c9c58 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.382636:0:22707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16400/0x892c60dda91c9c58 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.382640:0:22707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e16400 already unused, calling callback (ffffffffc17f54f0) 00010000:00010000:2.0:1788528778.382643:0:22707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16400/0x892c60dda91c9c58 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.382648:0:22707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16400/0x892c60dda91c9c58 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.382655:0:22707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a8fc1fa9e00) 00010000:00010000:2.0:1788528778.382658:0:22707:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788528778.382660:0:22707:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17400/0x892c60dda91c9c6d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.382667:0:22707:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17400/0x892c60dda91c9c6d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.382672:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17400/0x892c60dda91c9c6d lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.382692:0:22707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16400/0x892c60dda91c9c58 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.382702:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16400/0x892c60dda91c9c58 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 22707 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788528778.382926:0:22740:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788528778.382932:0:22740:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788528778.382948:0:22740:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1788528778.382953:0:22740:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788528778.383047:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f58c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:333a2baa-d5e5-441e-8b53-5d69075ed300+21:18768:x1875407719800192:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 Request processed in 56516us (56870us total) trans 12884901916 rc 0/0 00000100:00100000:2.0:1788528778.383057:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 63 00000020:00080000:2.0:1788528778.383072:0:22707:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00010000:00010000:1.0:1788528778.383611:0:22705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17400/0x892c60dda91c9c6d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528778.383620:0:22705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17400/0x892c60dda91c9c6d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528778.383734:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16000/0x892c60dda91c9c66 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03e5 expref: 21 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528778.383752:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e17400/0x892c60dda91c9c6d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0xbe4619e99f7c03e5 expref: 20 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528778.383772:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a8fc1fa9e00) 00010000:00010000:1.0:1788528778.383775:0:22705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788528778.383777:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a90f6e17400, rc 0) 00000100:00100000:1.0:1788528778.383825:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+20:18767:x1875407719800704:12345-192.168.203.38@tcp:101:dd.0 Request processed in 2823us (2996us total) trans 0 rc 0/0 00000100:00100000:1.0:1788528778.383832:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 64 00000100:00100000:3.0:1788528778.390534:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1788528778.390752:0:25752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719800960 00000100:00100000:1.0:1788528778.390763:0:25752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719800960 00000100:00100000:1.0:1788528778.390828:0:25752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 11 00000100:00100000:1.0:1788528778.390839:0:25752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:333a2baa-d5e5-441e-8b53-5d69075ed300+20:18768:x1875407719800960:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788528778.391241:0:25752:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788528778.391323:0:25752:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:1.0:1788528778.391358:0:25752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16a00/0x892c60dda91c9c7b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528778.391373:0:25752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16a00/0x892c60dda91c9c7b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 25752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528778.391383:0:25752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16a00/0x892c60dda91c9c7b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 25752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528778.391392:0:25752:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16a00/0x892c60dda91c9c7b lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 25752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528778.391399:0:25752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16a00/0x892c60dda91c9c7b lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 25752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528778.391405:0:25752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16a00/0x892c60dda91c9c7b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 25752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528778.391431:0:25752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788528778.391581:0:25102:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788528778.391588:0:25102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16a00/0x892c60dda91c9c7b lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 25752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528778.391595:0:25102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90f6e16a00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:0.0:1788528778.391600:0:25102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16a00/0x892c60dda91c9c7b lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 25752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528778.391608:0:25102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16a00/0x892c60dda91c9c7b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 25752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528778.391621:0:25102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a8fc3770600) 00010000:00010000:0.0:1788528778.391623:0:25102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788528778.391628:0:25102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16a00/0x892c60dda91c9c7b lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 25752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528778.391635:0:25102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a90f6e16a00/0x892c60dda91c9c7b lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 25752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528778.391648:0:25102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528778.391656:0:25102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788528778.391657:0:25102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788528778.391706:0:25752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:333a2baa-d5e5-441e-8b53-5d69075ed300+22:18768:x1875407719800960:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 Request processed in 868us (1181us total) trans 12884901918 rc 0/0 00000100:00100000:1.0:1788528778.391715:0:25752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 11 00000020:00080000:1.0:1788528778.391720:0:25752:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788528778.412343:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1788528778.412387:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1788528778.412591:0:24218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719801216 00000100:00100000:3.0:1788528778.412602:0:24218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719801216 00000100:00100000:3.0:1788528778.412658:0:24218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407719801088 00000100:00100000:3.0:1788528778.412662:0:24218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407719801088 00000100:00100000:0.0:1788528778.412677:0:24217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:0.0:1788528778.412690:0:24217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9101351180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+8:2403:x1875407719801216:12345-192.168.203.38@tcp:4:dd.0 00002000:00010000:0.0:1788528778.412738:0:24217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a9ac889, atime: 0x6a9ac888, ctime: 0x6a9ac889, blocks: 0x0 00010000:00010000:0.0:1788528778.412748:0:24217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084527d05/0x892c60dda91c9c82 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528778.412765:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=647s v=(0 0) 00010000:00010000:0.0:1788528778.412770:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788528778.412776:0:24217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084527d05/0x892c60dda91c9c82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788528778.412791:0:24217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084527d05/0x892c60dda91c9c82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788528778.444037:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788528778.519293:0:25028:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901895 is committed 00000001:00080000:1.0:1788528778.519311:0:25028:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901894 is committed 00002000:00010000:2.0:1788528778.519781:0:24217:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:2.0:1788528778.519786:0:24217:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 1788528777 -> 1788528778 00002000:00010000:2.0:1788528778.519789:0:24217:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1788528777 -> 1788528778 00002000:00010000:2.0:1788528778.519800:0:24217:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:2.0:1788528778.519818:0:24217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084527d05/0x892c60dda91c9c82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.519833:0:24217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084527d05/0x892c60dda91c9c82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.519848:0:24217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084527d05/0x892c60dda91c9c82 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.519856:0:24217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c0030c00 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:2.0:1788528778.519871:0:24217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084527d05/0x892c60dda91c9c82 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.519881:0:24217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084527d05/0x892c60dda91c9c82 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.519899:0:24217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084527d05/0x892c60dda91c9c82 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.519907:0:24217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084527d05/0x892c60dda91c9c82 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528778.520013:0:24217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9101351180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+6:2403:x1875407719801216:12345-192.168.203.38@tcp:4:dd.0 Request processed in 107323us (107676us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1788528778.520026:0:24217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:2.0:1788528778.520055:0:24217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1 00000100:00100000:2.0:1788528778.520064:0:24217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9101350e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+5:2403:x1875407719801088:12345-192.168.203.38@tcp:4:dd.0 00002000:00010000:2.0:1788528778.520101:0:24217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 7654321, mtime: 0x6a9ac88a, atime: 0x6a9ac888, ctime: 0x6a9ac88a, blocks: 0x1a68 00010000:00010000:2.0:1788528778.520108:0:24217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be5ac003/0x892c60dda91c9c89 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.520119:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=647s v=(0 0) 00010000:00010000:2.0:1788528778.520124:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788528778.520130:0:24217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be5ac003/0x892c60dda91c9c89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.520141:0:24217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be5ac003/0x892c60dda91c9c89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788528778.586813:0:25028:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901896 is committed 00002000:00010000:2.0:1788528778.587087:0:24217:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:2.0:1788528778.587108:0:24217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be5ac003/0x892c60dda91c9c89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.587121:0:24217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be5ac003/0x892c60dda91c9c89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.587131:0:24217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be5ac003/0x892c60dda91c9c89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.587137:0:24217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a90c68db800 already unused, calling callback (ffffffffc0bf5660) 00010000:00010000:2.0:1788528778.587143:0:24217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be5ac003/0x892c60dda91c9c89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.587152:0:24217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be5ac003/0x892c60dda91c9c89 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.587170:0:24217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be5ac003/0x892c60dda91c9c89 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788528778.587179:0:24217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be5ac003/0x892c60dda91c9c89 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788528778.587303:0:24217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9101350e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:333a2baa-d5e5-441e-8b53-5d69075ed300+5:2403:x1875407719801088:12345-192.168.203.38@tcp:4:dd.0 Request processed in 67236us (174910us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1788528778.587314:0:24217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1 00000100:00100000:2.0:1788528778.943007:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f58c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735631616:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788528778.943080:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528778.943186:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735631616 00000100:00100000:0.0:1788528778.943194:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735631616 00000100:00100000:0.0:1788528778.943253:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788528778.943263:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9101351f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735631616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788528778.943296:0:23449:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:2.0:1788528778.943482:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f58c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1875407735631616:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788528778.943484:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788528778.943508:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a90f6f0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735631744:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788528778.943539:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788528778.943606:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9101351f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875407735631616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788528778.943615:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788528778.943630:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875407735631744 00000100:00100000:0.0:1788528778.943634:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875407735631744 00000100:00100000:0.0:1788528778.943650:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788528778.943753:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a90f6f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735631744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788528778.943769:0:23449:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788528778.943824:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a90f6f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875407735631744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788528778.945392:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a90f6f0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1875407735631744:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788528778.957470:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000040:00080000:1.0:1788528779.073391:0:23462:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788528779.454800:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788528780.481919:0:25102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788528780.739413:0:25789:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1788528781.511068:0:22694:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788528782.530822:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 14449 lines, 14449 kept, 0 dropped, 0 bad.