00000100:00100000:1.0F:1790391628.168017:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391628.168088:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0F:1790391628.168098:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169671936 00000100:00100000:3.0:1790391628.168114:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169671936 00000100:00100000:1.0:1790391628.168120:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391628.168157:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391628.168171:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 167 00000100:00100000:3.0:1790391628.168185:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de820afa-b30f-4af2-bd45-eaefa881a982+13:2384:x1877361169671936:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391628.168186:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391628.168227:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391628.168269:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de820afa-b30f-4af2-bd45-eaefa881a982+13:2384:x1877361169671936:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 87us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391628.168276:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 167 00000100:00100000:0.0F:1790391628.169978:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169672448 00000100:00100000:0.0:1790391628.169998:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169672448 00000100:00100000:0.0:1790391628.170072:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169672960 00000100:00100000:0.0:1790391628.170076:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169672960 00000100:00100000:0.0:1790391628.170101:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 27 00000100:00100000:0.0:1790391628.170111:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+5:2384:x1877361169672448:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391628.170409:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391628.170431:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391628.170457:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391628.170475:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169672192 00000100:00100000:1.0:1790391628.170479:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169672192 00000100:00100000:1.0:1790391628.170502:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169672704 00000100:00100000:1.0:1790391628.170505:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169672704 00000100:00100000:1.0:1790391628.170518:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169672064 00000100:00100000:1.0:1790391628.170520:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169672064 00000100:00100000:1.0:1790391628.170531:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169672576 00000100:00100000:1.0:1790391628.170534:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169672576 00000100:00100000:1.0:1790391628.170549:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 63 00000100:00100000:1.0:1790391628.170556:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+5:2384:x1877361169672192:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391628.170594:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+5:2384:x1877361169672192:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 39us (2507us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391628.170601:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 63 00000100:00100000:1.0:1790391628.170615:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 64 00000100:00100000:1.0:1790391628.170622:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:957e4510-6da1-45ee-bf96-cb07984ae4a9+5:2384:x1877361169672704:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391628.170644:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:957e4510-6da1-45ee-bf96-cb07984ae4a9+5:2384:x1877361169672704:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 23us (2487us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391628.170650:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 64 00000100:00100000:1.0:1790391628.170661:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 65 00000100:00100000:1.0:1790391628.170667:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+22:2384:x1877361169672064:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391628.170722:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+22:2384:x1877361169672064:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 54us (2495us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391628.170728:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 65 00000100:00100000:1.0:1790391628.170740:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 66 00000100:00100000:1.0:1790391628.170746:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:957e4510-6da1-45ee-bf96-cb07984ae4a9+6:2384:x1877361169672576:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391628.170784:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:957e4510-6da1-45ee-bf96-cb07984ae4a9+6:2384:x1877361169672576:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 38us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391628.170791:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 66 00000100:00100000:1.0:1790391628.170809:0:19144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169672320 00000100:00100000:1.0:1790391628.170812:0:19144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169672320 00000100:00100000:1.0:1790391628.170828:0:19144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169672832 00000100:00100000:1.0:1790391628.170831:0:19144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169672832 00000100:00100000:1.0:1790391628.170843:0:19144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 28 00000100:00100000:1.0:1790391628.170849:0:19144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:957e4510-6da1-45ee-bf96-cb07984ae4a9+5:2384:x1877361169672960:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391628.170871:0:19144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:957e4510-6da1-45ee-bf96-cb07984ae4a9+5:2384:x1877361169672960:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 22us (2690us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391628.170894:0:19144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 28 00000100:00100000:1.0:1790391628.170906:0:19144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 29 00000100:00100000:1.0:1790391628.170912:0:19144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:89b7dd42-ca89-4c21-9061-6e0347f78f2b+5:2384:x1877361169672320:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391628.170934:0:19144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:89b7dd42-ca89-4c21-9061-6e0347f78f2b+5:2384:x1877361169672320:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 23us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391628.170939:0:19144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 29 00000100:00100000:1.0:1790391628.170950:0:19144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 30 00000100:00100000:1.0:1790391628.170955:0:19144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:957e4510-6da1-45ee-bf96-cb07984ae4a9+5:2384:x1877361169672832:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391628.170983:0:19144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:957e4510-6da1-45ee-bf96-cb07984ae4a9+5:2384:x1877361169672832:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 28us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391628.170990:0:19144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 30 00000100:00080000:1.0:1790391628.173002:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790391628.173012:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790391628.173015:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790391628.173017:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790391628.177915:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+5:2384:x1877361169672448:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 7791us (9782us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391628.177932:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 27 00010000:00010000:2.0F:1790391628.296387:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391628.296670:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790391628.296692:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186529024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790391628.296757:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391628.296811:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186529024 00000100:00100000:1.0:1790391628.296818:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186529024 00000100:00100000:1.0:1790391628.296870:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790391628.296895:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186529024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790391628.296922:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1790391628.296961:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186529024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391628.296968:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1790391628.296986:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790391628.297014:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186529024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790391628.297256:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186529152:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790391628.297288:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391628.297324:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186529152 00000100:00100000:0.0:1790391628.297328:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186529152 00000100:00100000:0.0:1790391628.297356:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790391628.297362:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186529152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790391628.297372:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1790391628.297398:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186529152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 37us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391628.297404:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1790391628.297417:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790391628.297434:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186529152:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790391628.808060:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790391628.808085:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186529280:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790391628.808156:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391628.808223:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186529280 00000100:00100000:0.0:1790391628.808230:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186529280 00000100:00100000:0.0:1790391628.808281:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790391628.808291:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186529280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790391628.808345:0:17207:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790391628.808391:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186529280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391628.808398:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790391628.808445:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186529280:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790391628.808631:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790391628.808641:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186529408:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790391628.808669:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391628.808696:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186529408 00000100:00100000:1.0:1790391628.808700:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186529408 00000100:00100000:1.0:1790391628.808726:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790391628.808733:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186529408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790391628.808757:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1790391628.808810:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186529408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391628.808817:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790391628.808844:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186529408:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1790391629.321406:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790391629.897973:0:17954:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790391630.348164:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790391630.355796:0:17182:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:1.0:1790391630.355818:0:17182:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e51823dab40 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:1.0:1790391630.355938:0:17182:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e5290261100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e51823da0c0 00000020:00080000:1.0:1790391630.355941:0:17182:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e5290261800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e52b564ac00 00010000:00010000:0.0:1790391630.356318:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055c00/0x2b1b7949f13e2870 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391630.356330:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055c00/0x2b1b7949f13e2870 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391630.356338:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055c00/0x2b1b7949f13e2870 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391630.356343:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5184055c00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391630.356348:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055c00/0x2b1b7949f13e2870 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391630.356497:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055c00/0x2b1b7949f13e2870 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391630.356515:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:0.0:1790391630.356518:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391630.356523:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055c00/0x2b1b7949f13e2870 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391630.356530:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055c00/0x2b1b7949f13e2870 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1790391630.356808:0:17241:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:3.0:1790391630.356900:0:17241:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:3.0:1790391631.372370:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186529792:0@lo:400:kworker.0 00000100:00100000:3.0:1790391631.372443:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391631.372500:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186530304:0@lo:400:kworker.0 00000100:00100000:3.0:1790391631.372522:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391631.372548:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1877361186530816:0@lo:400:kworker.0 00000100:00100000:3.0:1790391631.372571:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391631.372589:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1790391631.372595:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186529664:0@lo:400:kworker.0 00000100:00100000:3.0:1790391631.372617:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391631.372642:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186530176:0@lo:400:kworker.0 00000100:00100000:3.0:1790391631.372680:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391631.372695:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183828e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1877361186530688:0@lo:400:kworker.0 00000100:00100000:3.0:1790391631.372713:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391631.372737:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186529792 00000100:00100000:3.0:1790391631.372744:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186529792 00000100:00100000:2.0:1790391631.372785:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183828380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186529920:0@lo:400:kworker.0 00000100:00100000:3.0:1790391631.372794:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186530304 00000100:00100000:3.0:1790391631.372797:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186530304 00000100:00100000:2.0:1790391631.372814:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391631.372839:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186530432:0@lo:400:kworker.0 00000100:00100000:2.0:1790391631.372861:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391631.372952:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3638:1877361186529536:0@lo:400:kworker.0 00000100:00100000:1.0:1790391631.372988:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391631.373012:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877361186530048:0@lo:400:kworker.0 00000100:00100000:1.0:1790391631.373035:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391631.373051:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877361186530560:0@lo:400:kworker.0 00000100:00100000:1.0:1790391631.373072:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391631.373086:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1877361186531072:0@lo:400:kworker.0 00000100:00100000:1.0:1790391631.373104:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391631.374783:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1877361186530944:0@lo:400:kworker.0 00000100:00100000:2.0:1790391631.374835:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790391631.375532:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391631.375546:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186529664 00000100:00100000:2.0:1790391631.375554:0:18189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186529664 00000100:00100000:2.0:1790391631.375596:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186530176 00000100:00100000:2.0:1790391631.375599:0:18189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186530176 00000100:00100000:2.0:1790391631.375617:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790391631.375625:0:18189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183815c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186529664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391631.375695:0:18189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183815c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186529664:12345-0@lo:400:kworker.0 Request processed in 70us (3076us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391631.375703:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790391631.375718:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790391631.375724:0:18189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186530176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391631.375754:0:18189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186530176:12345-0@lo:400:kworker.0 Request processed in 30us (3073us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391631.375760:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790391631.397908:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186529920 00000100:00100000:3.0:1790391631.397926:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186529920 00000100:00100000:1.0:1790391631.401101:0:19144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186530432 00000100:00100000:1.0:1790391631.401120:0:19144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186530432 00000100:00100000:1.0:1790391631.401209:0:19144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790391631.401222:0:19144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183baad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186529792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391631.401254:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790391631.401263:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183816300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186530304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391631.404231:0:18708:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1790391631.404256:0:18708:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1790391631.404298:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186530816 00000100:00100000:0.0:1790391631.404310:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186530816 00000100:00100000:0.0:1790391631.404351:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186530688 00000100:00100000:0.0:1790391631.404354:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186530688 00000100:00100000:0.0:1790391631.404371:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186530048 00000100:00100000:0.0:1790391631.404373:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186530048 00000100:00100000:0.0:1790391631.404388:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186530560 00000100:00100000:0.0:1790391631.404391:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186530560 00000100:00100000:0.0:1790391631.404402:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186531072 00000100:00100000:0.0:1790391631.404405:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186531072 00000100:00100000:0.0:1790391631.404419:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186530944 00000100:00100000:0.0:1790391631.404422:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186530944 00000100:00100000:0.0:1790391631.404441:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790391631.404450:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877361186530816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391631.412912:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183816300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186530304:12345-0@lo:400:kworker.0 Request processed in 11637us (40375us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391631.412927:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790391631.412965:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790391631.412980:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186529920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391631.413064:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186529920:12345-0@lo:400:kworker.0 Request processed in 92us (40249us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391631.413071:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790391631.413081:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790391631.413088:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7792a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186530432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391631.413132:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7792a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186530432:12345-0@lo:400:kworker.0 Request processed in 45us (40270us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391631.413138:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1790391631.413165:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790391631.413180:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790391631.413183:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790391631.413186:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790391631.413207:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186531200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790391631.413242:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391631.413304:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186529664:0@lo:400:kworker.0 00000100:00100000:3.0:1790391631.413316:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186530176:0@lo:400:kworker.0 00000100:00100000:3.0:1790391631.413328:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186530304:0@lo:400:kworker.0 00000100:00100000:3.0:1790391631.413357:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186529792:0@lo:400:kworker.0 00000100:00100000:3.0:1790391631.413468:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183828380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186529920:0@lo:400:kworker.0 00000100:00100000:3.0:1790391631.413478:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186530432:0@lo:400:kworker.0 00000100:00100000:3.0:1790391631.413496:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186531200 00000100:00100000:3.0:1790391631.413501:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186531200 00000100:00100000:3.0:1790391631.413823:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790391631.413831:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183816d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186531200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790391631.413855:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1790391631.413913:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183816d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186531200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391631.413920:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790391631.413951:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186531200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790391631.414000:0:20339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790391631.414008:0:20339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877361186530688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391631.414042:0:20339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877361186530688:12345-0@lo:400:kworker.0 Request processed in 36us (41327us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391631.414047:0:20339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790391631.414061:0:20339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790391631.414067:0:20339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877361186530048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391631.414109:0:20339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877361186530048:12345-0@lo:400:kworker.0 Request processed in 42us (41073us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391631.414114:0:20339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790391631.414124:0:20339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790391631.414130:0:20339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877361186530560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391631.414164:0:20339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877361186530560:12345-0@lo:400:kworker.0 Request processed in 35us (41091us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391631.414180:0:20339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790391631.414193:0:20339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790391631.414199:0:20339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877361186531072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391631.414226:0:20339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877361186531072:12345-0@lo:400:kworker.0 Request processed in 28us (41122us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391631.414232:0:20339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790391631.414242:0:20339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790391631.414248:0:20339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7790700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1877361186530944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391631.414281:0:20339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7790700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1877361186530944:12345-0@lo:400:kworker.0 Request processed in 33us (39446us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391631.414286:0:20339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790391631.414308:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186529536 00000100:00100000:3.0:1790391631.414312:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186529536 00000100:00100000:3.0:1790391631.414336:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1790391631.414342:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7674850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+24:3638:x1877361186529536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391631.414372:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7674850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+24:3638:x1877361186529536:12345-0@lo:400:kworker.0 Request processed in 30us (41383us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391631.414377:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1790391631.414435:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183815500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186531328:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790391631.414462:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391631.414489:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183828e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1877361186530688:0@lo:400:kworker.0 00000100:00100000:3.0:1790391631.414515:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3638:1877361186529536:0@lo:400:kworker.0 00000100:00100000:3.0:1790391631.415836:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877361186530048:0@lo:400:kworker.0 00000100:00100000:3.0:1790391631.415850:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877361186530560:0@lo:400:kworker.0 00010000:00080000:3.0:1790391631.415866:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183828a80 x1877361186531072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391631.415892:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1877361186531072:0@lo:400:kworker.0 00000100:00100000:3.0:1790391631.415940:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1877361186530944:0@lo:400:kworker.0 00000100:00100000:3.0:1790391631.415971:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186531328 00000100:00100000:3.0:1790391631.415977:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186531328 00000100:00100000:1.0:1790391631.416012:0:19144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183baad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186529792:12345-0@lo:400:kworker.0 Request processed in 14792us (43566us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391631.416014:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790391631.416020:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183815180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186531328:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790391631.416030:0:19144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00002000:00000024:3.0:1790391631.416053:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1790391631.418813:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183815180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186531328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2780us (4338us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391631.418830:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790391631.418938:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183815500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186531328:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790391631.427841:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877361186530816:12345-0@lo:400:kworker.0 Request processed in 23381us (55257us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391631.427867:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:1.0:1790391631.428183:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518382b100 x1877361186530816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391631.428199:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1877361186530816:0@lo:400:kworker.0 00000100:00100000:1.0:1790391631.742326:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391631.742363:0:20339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169673088 00000100:00100000:1.0:1790391631.742373:0:20339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169673088 00000100:00100000:1.0:1790391631.742438:0:20339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 65 00000100:00100000:1.0:1790391631.742449:0:20339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89b7dd42-ca89-4c21-9061-6e0347f78f2b+13:15582:x1877361169673088:12345-192.168.202.28@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1790391631.742550:0:20339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89b7dd42-ca89-4c21-9061-6e0347f78f2b+13:15582:x1877361169673088:12345-192.168.202.28@tcp:60:lhsmtool_posix.0 Request processed in 102us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391631.742556:0:20339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 65 00000100:00080000:1.0:1790391631.742578:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790391631.757463:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391631.764602:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169673216 00000100:00100000:1.0:1790391631.764621:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169673216 00000100:00100000:1.0:1790391631.764699:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 66 00000100:00100000:1.0:1790391631.764710:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+5:15582:x1877361169673216:12345-192.168.202.28@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1790391631.764829:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+5:15582:x1877361169673216:12345-192.168.202.28@tcp:60:lhsmtool_posix.0 Request processed in 121us (7380us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391631.764837:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 66 00000100:00080000:1.0:1790391631.764960:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790391631.782112:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391631.782158:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169673472 00000100:00100000:1.0:1790391631.782178:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169673472 00000100:00100000:1.0:1790391631.782239:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 12 00000100:00100000:1.0:1790391631.782259:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+13:15582:x1877361169673472:12345-192.168.202.28@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790391631.782488:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+14:15582:x1877361169673472:12345-192.168.202.28@tcp:35:lhsmtool_posix.0 Request processed in 229us (391us total) trans 8589934623 rc 0/0 00000100:00100000:1.0:1790391631.782496:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 12 00010000:00010000:0.0:1790391632.392146:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391633.295528:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391633.295629:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391633.295676:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391633.295711:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391633.295765:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169673984 00000100:00100000:1.0:1790391633.295778:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169673984 00000100:00100000:1.0:1790391633.295849:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 35 00000100:00100000:1.0:1790391633.295861:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+5:2381:x1877361169673984:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391633.295970:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+5:2381:x1877361169673984:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 111us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391633.295978:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 35 00000100:00080000:1.0:1790391633.295999:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790391633.297448:0:20339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169673856 00000100:00100000:2.0:1790391633.297463:0:20339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169673856 00000100:00100000:2.0:1790391633.297532:0:20339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169673728 00000100:00100000:2.0:1790391633.297535:0:20339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169673728 00000100:00100000:2.0:1790391633.297560:0:20339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 73 00000100:00100000:2.0:1790391633.297571:0:20339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89b7dd42-ca89-4c21-9061-6e0347f78f2b+5:2381:x1877361169673856:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391633.297674:0:20339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89b7dd42-ca89-4c21-9061-6e0347f78f2b+5:2381:x1877361169673856:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 105us (2044us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391633.297681:0:20339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 73 00000100:00100000:2.0:1790391633.297697:0:20339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 74 00000100:00100000:2.0:1790391633.297704:0:20339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89b7dd42-ca89-4c21-9061-6e0347f78f2b+14:2381:x1877361169673728:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391633.297734:0:20339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89b7dd42-ca89-4c21-9061-6e0347f78f2b+14:2381:x1877361169673728:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 30us (2058us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391633.297740:0:20339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 74 00000100:00080000:1.0:1790391633.297997:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790391633.298003:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790391633.305452:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169673600 00000100:00100000:3.0:1790391633.305470:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169673600 00000100:00100000:3.0:1790391633.305543:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 169 00000100:00100000:3.0:1790391633.305554:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de820afa-b30f-4af2-bd45-eaefa881a982+13:2381:x1877361169673600:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:3.0:1790391633.305851:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de820afa-b30f-4af2-bd45-eaefa881a982+13:2381:x1877361169673600:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 298us (10336us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391633.305859:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 169 00000100:00100000:1.0:1790391633.306904:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391633.306946:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391633.306980:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391633.307052:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169674240 00000100:00100000:0.0:1790391633.307059:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169674240 00000100:00100000:0.0:1790391633.307116:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169674368 00000100:00100000:0.0:1790391633.307119:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169674368 00000100:00100000:0.0:1790391633.307140:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 75 00000100:00100000:0.0:1790391633.307165:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:957e4510-6da1-45ee-bf96-cb07984ae4a9+6:2381:x1877361169674240:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391633.307225:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:957e4510-6da1-45ee-bf96-cb07984ae4a9+6:2381:x1877361169674240:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 76us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391633.307233:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 75 00000100:00100000:0.0:1790391633.307256:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 76 00000100:00100000:0.0:1790391633.307263:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:957e4510-6da1-45ee-bf96-cb07984ae4a9+5:2382:x1877361169674368:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391633.307285:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:957e4510-6da1-45ee-bf96-cb07984ae4a9+5:2382:x1877361169674368:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 23us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391633.307291:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 76 00000100:00080000:1.0:1790391633.307527:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790391633.307532:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790391633.307752:0:19144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169674112 00000100:00100000:2.0:1790391633.307758:0:19144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169674112 00000100:00100000:2.0:1790391633.307808:0:19144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 30 00000100:00100000:2.0:1790391633.307816:0:19144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:89b7dd42-ca89-4c21-9061-6e0347f78f2b+5:2380:x1877361169674112:12345-192.168.202.28@tcp:9:kworker.0 00000020:00000080:2.0:1790391633.307837:0:19144:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e25a6 00000100:00080000:2.0:1790391633.307853:0:19144:0:(import.c:65:import_set_state_nolock()) ffff9e518214f000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790391633.307945:0:19144:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1790391633.308075:0:19144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:89b7dd42-ca89-4c21-9061-6e0347f78f2b+2:2380:x1877361169674112:12345-192.168.202.28@tcp:9:kworker.0 Request processed in 260us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391633.308083:0:19144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 30 00000100:00080000:1.0:1790391633.308248:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1790391633.309263:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391633.316375:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391633.316476:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391633.316673:0:20517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169674496 00000100:00100000:1.0:1790391633.316684:0:20517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169674496 00000100:00100000:1.0:1790391633.316762:0:20517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169674624 00000100:00100000:1.0:1790391633.316780:0:20517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169674624 00000100:00100000:1.0:1790391633.316812:0:20517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 31 00000100:00100000:1.0:1790391633.316823:0:20517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:957e4510-6da1-45ee-bf96-cb07984ae4a9+5:2380:x1877361169674496:12345-192.168.202.28@tcp:9:kworker.0 00000020:00000080:1.0:1790391633.316856:0:20517:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e25de 00000100:00080000:1.0:1790391633.316873:0:20517:0:(import.c:65:import_set_state_nolock()) ffff9e52878bd000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790391633.316945:0:20517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1790391633.317111:0:20517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:957e4510-6da1-45ee-bf96-cb07984ae4a9+2:2380:x1877361169674496:12345-192.168.202.28@tcp:9:kworker.0 Request processed in 290us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391633.317121:0:20517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 31 00000100:00100000:1.0:1790391633.317138:0:20517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 32 00000100:00100000:1.0:1790391633.317164:0:20517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:957e4510-6da1-45ee-bf96-cb07984ae4a9+5:2380:x1877361169674624:12345-192.168.202.28@tcp:9:kworker.0 00000020:00000080:1.0:1790391633.317179:0:20517:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e25e5 00000100:00080000:1.0:1790391633.317185:0:20517:0:(import.c:65:import_set_state_nolock()) ffff9e5182096000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790391633.317208:0:20517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1790391633.317276:0:20517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:957e4510-6da1-45ee-bf96-cb07984ae4a9+2:2380:x1877361169674624:12345-192.168.202.28@tcp:9:kworker.0 Request processed in 130us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391633.317284:0:20517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 32 00010000:00010000:1.0:1790391633.317338:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391633.317345:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790391633.317587:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790391633.317593:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790391633.416493:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186531456:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790391633.416577:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391633.416995:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186531456 00000100:00100000:0.0:1790391633.417005:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186531456 00000100:00100000:0.0:1790391633.417071:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790391633.417081:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183814700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186531456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790391633.417109:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1790391633.417169:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183814700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186531456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391633.417176:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1790391633.417331:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790391633.417467:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391633.417541:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186531456:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790391633.425540:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790391633.425567:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7792d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186531584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790391633.425659:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391633.425863:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186531584 00000100:00100000:0.0:1790391633.425872:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186531584 00000100:00100000:0.0:1790391633.425964:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790391633.425975:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183817800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186531584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790391633.426019:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1790391633.426068:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183817800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186531584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391633.426075:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790391633.426180:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7792d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186531584:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790391633.426421:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790391633.928216:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790391633.928245:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186531712:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790391633.928595:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391633.929424:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790391633.929439:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7793b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186531840:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790391633.929479:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391633.937472:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186531712 00000100:00100000:0.0:1790391633.937491:0:18189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186531712 00000100:00100000:0.0:1790391633.937665:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186531840 00000100:00100000:0.0:1790391633.937670:0:18189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186531840 00000100:00100000:1.0:1790391633.937766:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790391633.937779:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186531712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790391633.939533:0:17207:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790391633.939652:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186531712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1872us (11054us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391633.939677:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790391633.939709:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790391633.939719:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186531840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790391633.939752:0:17207:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1790391633.939789:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186531840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (10309us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391633.939796:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790391633.940115:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7793b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186531840:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790391633.940167:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186531712:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1790391634.440321:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790391635.018337:0:17237:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1790391635.018347:0:17237:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790391635.018369:0:17237:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1790391635.018377:0:17237:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000001:02000400:2.0:1790391635.360769:0:20576:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 23:00:34 (1790391634) 00010000:00010000:2.0:1790391635.465947:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391636.488113:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186531968:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790391636.488204:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391636.488278:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186531968 00000100:00100000:3.0:1790391636.488286:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186531968 00000100:00100000:3.0:1790391636.488340:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790391636.488350:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183814380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186531968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790391636.488379:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1790391636.488426:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183814380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186531968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391636.488433:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1790391636.488457:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790391636.488500:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186531968:0@lo:13:osp-pre-1-1.0 00000001:00080000:0.0:1790391636.490970:0:17182:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:0.0:1790391636.490985:0:17182:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:3.0:1790391636.492279:0:17241:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:3.0:1790391636.492293:0:17241:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000100:00100000:3.0:1790391636.492312:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7790380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186532352:0@lo:400:kworker.0 00000100:00100000:3.0:1790391636.492380:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391636.492423:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7791880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186532864:0@lo:400:kworker.0 00000100:00100000:3.0:1790391636.492446:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391636.492464:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7793800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1877361186533376:0@lo:400:kworker.0 00000100:00100000:3.0:1790391636.492486:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391636.492512:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1790391636.492517:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7791180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3640:1877361186532224:0@lo:400:kworker.0 00000100:00100000:3.0:1790391636.492543:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391636.492562:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7792680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877361186532736:0@lo:400:kworker.0 00000100:00100000:3.0:1790391636.492580:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391636.492597:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7791c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1877361186533248:0@lo:400:kworker.0 00000100:00100000:3.0:1790391636.492616:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391636.492645:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186532352 00000100:00100000:3.0:1790391636.492653:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186532352 00000100:00100000:3.0:1790391636.492943:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186532864 00000100:00100000:3.0:1790391636.492948:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186532864 00000100:00100000:3.0:1790391636.492968:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790391636.492977:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186532352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391636.493035:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186532352:12345-0@lo:400:kworker.0 Request processed in 58us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391636.493043:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790391636.493058:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790391636.493076:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186532864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391636.493101:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186532864:12345-0@lo:400:kworker.0 Request processed in 26us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391636.493107:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790391636.493139:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186533376 00000100:00100000:3.0:1790391636.493143:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186533376 00010000:00010000:0.0:1790391636.493856:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391636.493925:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186532224 00000100:00100000:0.0:1790391636.493933:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186532224 00000100:00100000:0.0:1790391636.493972:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1790391636.493991:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7674050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+24:3640:x1877361186532224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391636.494042:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7674050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+24:3640:x1877361186532224:12345-0@lo:400:kworker.0 Request processed in 53us (1498us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391636.494048:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1790391636.494083:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186532096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790391636.494114:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391636.494151:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7793100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186532608:0@lo:400:kworker.0 00000100:00100000:3.0:1790391636.494431:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186532736 00000100:00100000:3.0:1790391636.494436:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186532736 00000100:00100000:3.0:1790391636.494457:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186533248 00000100:00100000:3.0:1790391636.494459:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186533248 00000100:00100000:3.0:1790391636.494475:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1790391636.494482:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877361186533376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391636.494520:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877361186533376:12345-0@lo:400:kworker.0 Request processed in 39us (2033us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391636.494526:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1790391636.494539:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790391636.494544:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183817100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877361186532736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391636.494569:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183817100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877361186532736:12345-0@lo:400:kworker.0 Request processed in 26us (1988us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391636.494575:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790391636.494585:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790391636.494591:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877361186533248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391636.494616:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877361186533248:12345-0@lo:400:kworker.0 Request processed in 26us (2000us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391636.494621:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:3.0:1790391636.494654:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790391636.494658:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790391636.494682:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186532096 00000100:00100000:3.0:1790391636.494686:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186532096 00000100:00100000:0.0:1790391636.495061:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391636.495088:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7791500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877361186533120:0@lo:400:kworker.0 00000100:00100000:0.0:1790391636.495115:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391636.495143:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7792300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1877361186533632:0@lo:400:kworker.0 00000100:00100000:0.0:1790391636.495162:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391636.495843:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1790391636.495854:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7790a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186532480:0@lo:400:kworker.0 00000100:00100000:0.0:1790391636.495914:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391636.495954:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7791f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186532992:0@lo:400:kworker.0 00000100:00100000:3.0:1790391636.497169:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790391636.497249:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186532096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790391636.497276:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1790391636.497334:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186532096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (3219us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391636.497341:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790391636.497371:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186532608 00000100:00100000:3.0:1790391636.497379:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186532608 00000100:00100000:3.0:1790391636.497410:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186532480 00000100:00100000:3.0:1790391636.497413:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186532480 00000100:00100000:3.0:1790391636.497436:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790391636.497442:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292338e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186532608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391636.497474:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292338e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186532608:12345-0@lo:400:kworker.0 Request processed in 32us (2414us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391636.497481:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790391636.497492:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790391636.497498:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292339880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186532480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391636.497525:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292339880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186532480:12345-0@lo:400:kworker.0 Request processed in 27us (1610us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391636.497530:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790391636.497548:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186533120 00000100:00100000:3.0:1790391636.497552:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186533120 00000100:00100000:3.0:1790391636.497574:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186533632 00000100:00100000:3.0:1790391636.497576:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186533632 00000100:00100000:3.0:1790391636.497598:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790391636.497604:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292339500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877361186533120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391636.497647:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292339500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877361186533120:12345-0@lo:400:kworker.0 Request processed in 43us (2531us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391636.497653:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790391636.497665:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1790391636.497671:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529233b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877361186533632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391636.497800:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391636.497834:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7790000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1877361186533504:0@lo:400:kworker.0 00000100:00100000:0.0:1790391636.497866:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391636.497920:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186532096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790391636.497932:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7793100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186532608:0@lo:400:kworker.0 00000100:00100000:0.0:1790391636.497941:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7791500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877361186533120:0@lo:400:kworker.0 00010000:00080000:0.0:1790391636.497953:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52b7792300 x1877361186533632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391636.497962:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7792300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1877361186533632:0@lo:400:kworker.0 00000100:00100000:0.0:1790391636.498014:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7790a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186532480:0@lo:400:kworker.0 00000100:00100000:1.0:1790391636.498447:0:20517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186532992 00000100:00100000:1.0:1790391636.498453:0:20517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186532992 00000100:00100000:1.0:1790391636.498486:0:20517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790391636.498493:0:20517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186532992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391636.498539:0:20517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186532992:12345-0@lo:400:kworker.0 Request processed in 46us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391636.498545:0:20517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790391636.498576:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7791f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186532992:0@lo:400:kworker.0 00000100:00100000:3.0:1790391636.500332:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529233b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877361186533632:12345-0@lo:400:kworker.0 Request processed in 27us (2535us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391636.500360:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1790391636.500393:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186533504 00000100:00100000:3.0:1790391636.500402:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186533504 00000100:00100000:3.0:1790391636.500451:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1790391636.500459:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877361186533504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391636.500555:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877361186533504:12345-0@lo:400:kworker.0 Request processed in 97us (2687us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391636.500562:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1790391636.500610:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790391636.500613:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790391636.500616:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790391636.500619:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790391636.500649:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7791180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3640:1877361186532224:0@lo:400:kworker.0 00000100:00100000:3.0:1790391636.500665:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7792680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877361186532736:0@lo:400:kworker.0 00000100:00100000:3.0:1790391636.500677:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7791c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1877361186533248:0@lo:400:kworker.0 00000100:00100000:3.0:1790391636.500689:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7790380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186532352:0@lo:400:kworker.0 00000100:00100000:3.0:1790391636.503318:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7791880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186532864:0@lo:400:kworker.0 00010000:00080000:3.0:1790391636.503377:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52b7793800 x1877361186533376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391636.503388:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7793800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1877361186533376:0@lo:400:kworker.0 00000100:00100000:3.0:1790391636.503466:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7790000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1877361186533504:0@lo:400:kworker.0 00010000:00010000:3.0:1790391637.515246:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391638.409494:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391638.409600:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391638.409630:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391638.409686:0:20517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169675136 00000100:00100000:1.0:1790391638.409697:0:20517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169675136 00000100:00100000:1.0:1790391638.409776:0:20517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 39 00000100:00100000:1.0:1790391638.409786:0:20517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:89b7dd42-ca89-4c21-9061-6e0347f78f2b+5:2382:x1877361169675136:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391638.409856:0:20517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:89b7dd42-ca89-4c21-9061-6e0347f78f2b+5:2382:x1877361169675136:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 71us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391638.409864:0:20517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 39 00000100:00080000:0.0:1790391638.409971:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790391638.410921:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391638.410955:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391638.411011:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169674752 00000100:00100000:1.0:1790391638.411018:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169674752 00000100:00100000:1.0:1790391638.411063:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 171 00000100:00100000:1.0:1790391638.411071:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de820afa-b30f-4af2-bd45-eaefa881a982+13:2382:x1877361169674752:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391638.411134:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de820afa-b30f-4af2-bd45-eaefa881a982+13:2382:x1877361169674752:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 64us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391638.411141:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 171 00000100:00100000:3.0:1790391638.411576:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169674880 00000100:00100000:3.0:1790391638.411581:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169674880 00000100:00080000:1.0:1790391638.411649:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790391638.412143:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169675392 00000100:00100000:0.0:1790391638.412201:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169675392 00000100:00100000:0.0:1790391638.412291:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 83 00000100:00100000:0.0:1790391638.412301:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+13:2382:x1877361169674880:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391638.412364:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+13:2382:x1877361169674880:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 64us (3041us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391638.412372:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 83 00000100:00100000:0.0:1790391638.412546:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 84 00000100:00100000:0.0:1790391638.412555:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:957e4510-6da1-45ee-bf96-cb07984ae4a9+5:2382:x1877361169675392:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391638.412581:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:957e4510-6da1-45ee-bf96-cb07984ae4a9+5:2382:x1877361169675392:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 28us (2951us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391638.412600:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 84 00000100:00100000:2.0:1790391638.412937:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391638.413324:0:20339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169675008 00000100:00100000:2.0:1790391638.413339:0:20339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169675008 00000100:00100000:3.0:1790391638.413403:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169675264 00000100:00100000:3.0:1790391638.413407:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169675264 00000100:00080000:1.0:1790391638.413602:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790391638.413606:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790391638.413853:0:20339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 85 00000100:00100000:2.0:1790391638.413862:0:20339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89b7dd42-ca89-4c21-9061-6e0347f78f2b+5:2382:x1877361169675008:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391638.413941:0:20339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89b7dd42-ca89-4c21-9061-6e0347f78f2b+5:2382:x1877361169675008:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 80us (2984us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391638.413949:0:20339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 85 00000100:00100000:0.0:1790391638.414624:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 86 00000100:00100000:0.0:1790391638.414635:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:957e4510-6da1-45ee-bf96-cb07984ae4a9+6:2382:x1877361169675264:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391638.414683:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:957e4510-6da1-45ee-bf96-cb07984ae4a9+6:2382:x1877361169675264:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 51us (1747us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391638.414690:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 86 00010000:00010000:0.0:1790391638.536778:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391638.538716:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790391638.538738:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186533760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790391638.538821:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391638.538903:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186533760 00000100:00100000:3.0:1790391638.538911:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186533760 00000100:00100000:3.0:1790391638.538966:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790391638.538975:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186533760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790391638.539015:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000001:00100000:1.0:1790391638.539052:0:19520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 957e4510-6da1-45ee-bf96-cb07984ae4a9 00000020:00000080:1.0:1790391638.539062:0:19520:0:(genops.c:885:class_export_put()) final put ffff9e51838d1800/957e4510-6da1-45ee-bf96-cb07984ae4a9 00000100:00100000:3.0:1790391638.539072:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186533760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391638.539082:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000001:00100000:1.0:1790391638.539089:0:19520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 89b7dd42-ca89-4c21-9061-6e0347f78f2b 00000020:00000080:1.0:1790391638.539095:0:19520:0:(genops.c:885:class_export_put()) final put ffff9e518214c000/89b7dd42-ca89-4c21-9061-6e0347f78f2b 00000100:00080000:1.0:1790391638.539207:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1790391638.539229:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e51838d1800/957e4510-6da1-45ee-bf96-cb07984ae4a9 for lustre-OST0001 00000020:00000080:1.0:1790391638.539292:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e518214c000/89b7dd42-ca89-4c21-9061-6e0347f78f2b for lustre-OST0001 00000020:00000080:1.0:1790391638.539326:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5182096000 for lustre-OST0001 00000020:00000080:1.0:1790391638.539337:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e518214f000 for lustre-OST0001 00000100:00100000:2.0:1790391638.539342:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186533760:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1790391638.539522:0:18703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 957e4510-6da1-45ee-bf96-cb07984ae4a9 00000020:00000080:2.0:1790391638.539527:0:18703:0:(genops.c:885:class_export_put()) final put ffff9e51810c1800/957e4510-6da1-45ee-bf96-cb07984ae4a9 00000020:00000080:1.0:1790391638.539960:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e51810c1800/957e4510-6da1-45ee-bf96-cb07984ae4a9 for lustre-OST0000 00000020:00000080:1.0:1790391638.540009:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e52878bd000 for lustre-OST0000 00000100:00100000:2.0:1790391638.541437:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186533888:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790391638.541527:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391638.541976:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186533888 00000100:00100000:3.0:1790391638.541988:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186533888 00000100:00080000:1.0:1790391638.542213:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790391638.542259:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790391638.542272:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186533888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790391638.542303:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1790391638.542381:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186533888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391638.542409:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790391638.542504:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186533888:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790391639.048252:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790391639.048278:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186534016:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790391639.048328:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790391639.048343:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7791c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186534144:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790391639.048410:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391639.048491:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186534144 00000100:00100000:2.0:1790391639.048499:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186534144 00000100:00100000:2.0:1790391639.048573:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790391639.048582:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186534144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790391639.048618:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1790391639.049276:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391639.049495:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186534016 00000100:00100000:0.0:1790391639.049502:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186534016 00000100:00100000:0.0:1790391639.049540:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790391639.049548:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186534016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790391639.049571:0:17207:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790391639.049620:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186534016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391639.049628:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790391639.049676:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186534016:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790391639.059667:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186534144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 11074us (11244us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391639.059710:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790391639.064761:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7791c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186534144:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1790391639.112591:0:17954:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790391639.560259:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391640.584449:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391640.747339:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391640.747858:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169675648 00000100:00100000:1.0:1790391640.747869:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169675648 00000100:00100000:1.0:1790391640.747995:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 13 00000100:00100000:1.0:1790391640.748009:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7792680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+13:16344:x1877361169675648:12345-192.168.202.28@tcp:35:umount.0 00000001:00080000:1.0:1790391640.748343:0:17205:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:1.0:1790391640.748420:0:17205:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:1.0:1790391640.748565:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7792680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+16:16344:x1877361169675648:12345-192.168.202.28@tcp:35:umount.0 Request processed in 559us (1238us total) trans 8589934626 rc 0/0 00000100:00100000:1.0:1790391640.748574:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 13 00000020:00080000:1.0:1790391640.748579:0:17205:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00080000:2.0:1790391640.750217:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790391640.758460:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391640.758503:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391640.758533:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391640.758683:0:20226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169675776 00000100:00100000:2.0:1790391640.758693:0:20226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169675776 00000100:00100000:2.0:1790391640.758749:0:20226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169676032 00000100:00100000:2.0:1790391640.758752:0:20226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169676032 00000100:00100000:2.0:1790391640.758762:0:20226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169675904 00000100:00100000:2.0:1790391640.758765:0:20226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169675904 00000100:00100000:2.0:1790391640.758778:0:20226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 3 00000100:00100000:2.0:1790391640.758787:0:20226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de820afa-b30f-4af2-bd45-eaefa881a982+15:2381:x1877361169675776:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391640.758802:0:20226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391640.758820:0:20226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5280031a00/0x2b1b7949f13e257c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b04e9 expref: 15 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391640.758839:0:20226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391640.758931:0:20226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de820afa-b30f-4af2-bd45-eaefa881a982+14:2381:x1877361169675776:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 144us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391640.758938:0:20226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 3 00000100:00100000:2.0:1790391640.758955:0:20226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 4 00000100:00100000:2.0:1790391640.758961:0:20226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52c20c7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de820afa-b30f-4af2-bd45-eaefa881a982+13:2381:x1877361169676032:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391640.758968:0:20226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391640.758976:0:20226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5183087000/0x2b1b7949f13e2608 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b05d0 expref: 13 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391640.758985:0:20226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391640.759000:0:20226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52c20c7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de820afa-b30f-4af2-bd45-eaefa881a982+12:2381:x1877361169676032:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 39us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391640.759018:0:20226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 4 00000100:00100000:2.0:1790391640.759054:0:20226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 5 00000100:00100000:2.0:1790391640.759246:0:20226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de820afa-b30f-4af2-bd45-eaefa881a982+11:2381:x1877361169675904:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391640.759264:0:20226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391640.759273:0:20226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e518309d800/0x2b1b7949f13e2583 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b051a expref: 11 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391640.759282:0:20226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391640.759299:0:20226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de820afa-b30f-4af2-bd45-eaefa881a982+10:2381:x1877361169675904:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 56us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391640.759305:0:20226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 5 00000100:00100000:0.0:1790391640.762348:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391640.762533:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169676160 00000100:00100000:3.0:1790391640.762542:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169676160 00000100:00100000:3.0:1790391640.762605:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 33 00000100:00100000:3.0:1790391640.762615:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+5:2380:x1877361169676160:12345-192.168.202.28@tcp:9:umount.0 00000020:00000080:3.0:1790391640.762659:0:18707:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e259f 00000100:00080000:3.0:1790391640.762667:0:18707:0:(import.c:65:import_set_state_nolock()) ffff9e5182148800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790391640.762720:0:18707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1790391640.762939:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+2:2380:x1877361169676160:12345-192.168.202.28@tcp:9:umount.0 Request processed in 324us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391640.762946:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 33 00010000:00010000:1.0:1790391640.763609:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790391640.763774:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790391640.791568:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391640.791674:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169677056 00000100:00100000:0.0:1790391640.791683:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169677056 00000100:00100000:0.0:1790391640.791739:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 67 00000100:00100000:0.0:1790391640.791749:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+16:2380:x1877361169677056:12345-192.168.202.28@tcp:39:umount.0 00000020:00000080:0.0:1790391640.791779:0:17203:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e2591 00000020:00010000:0.0:1790391640.791794:0:17203:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9e5182ddc800: total 0 00000100:00080000:0.0:1790391640.791798:0:17203:0:(import.c:65:import_set_state_nolock()) ffff9e5182ddf800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790391640.791844:0:17203:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:0.0:1790391640.792024:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+15:2380:x1877361169677056:12345-192.168.202.28@tcp:39:umount.0 Request processed in 276us (466us total) trans 8589934627 rc 0/0 00000100:00100000:0.0:1790391640.792032:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 67 00000020:00010000:1.0:1790391640.792266:0:17191:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9e5182ddc800: total 0 00010000:00010000:1.0:1790391640.792270:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391640.792318:0:17191:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e5182ddc800, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1790391640.792350:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5283a48c00) 00010000:00010000:1.0:1790391640.792353:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790391640.792371:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e26b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b05ec expref: 14 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391640.792392:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:1.0:1790391640.792394:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790391640.792398:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c800/0x2b1b7949f13e2846 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b066a expref: 13 pid: 20339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391640.792417:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e52b9b6c800) 00010000:00010000:1.0:1790391640.792420:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790391640.792424:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e265c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b05d7 expref: 12 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391640.792452:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:1.0:1790391640.792455:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790391640.792459:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145a00/0x2b1b7949f13e273c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0616 expref: 11 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391640.792473:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e51831af600) 00010000:00010000:1.0:1790391640.792475:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790391640.792478:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144c00/0x2b1b7949f13e27eb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0655 expref: 10 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391640.792489:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e51831af600) 00010000:00010000:1.0:1790391640.792491:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790391640.792495:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145400/0x2b1b7949f13e27ba lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0640 expref: 9 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391640.792505:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e51831af600) 00010000:00010000:1.0:1790391640.792507:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790391640.792510:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055600/0x2b1b7949f13e28a8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b068d expref: 8 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391640.792523:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e5283a48100) 00010000:00010000:1.0:1790391640.792525:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391640.792529:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e2678 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b05de expref: 7 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391640.792540:0:17191:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e5182ddc800, canceled 8 locks, left on hash table 0. 00010000:00010000:1.0:1790391640.792552:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391640.792558:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391640.792559:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391640.814201:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391640.814352:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169677184 00000100:00100000:0.0:1790391640.814366:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169677184 00000100:00100000:0.0:1790391640.814466:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 68 00000100:00100000:0.0:1790391640.814482:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+5:2380:x1877361169677184:12345-192.168.202.28@tcp:39:umount.0 00000020:00000080:0.0:1790391640.814529:0:17202:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e2598 00000100:00080000:0.0:1790391640.814554:0:17202:0:(import.c:65:import_set_state_nolock()) ffff9e5182ddb000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790391640.814591:0:17202:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1790391640.814602:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1790391640.814673:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391640.816632:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+3:2380:x1877361169677184:12345-192.168.202.28@tcp:39:umount.0 Request processed in 2144us (2432us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1790391640.816656:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 68 00000100:00100000:1.0:1790391641.608149:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186534272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790391641.608286:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391641.608545:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3640:1877361186534400:0@lo:400:kworker.0 00000100:00100000:2.0:1790391641.608582:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391641.608616:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183828e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877361186534912:0@lo:400:kworker.0 00000100:00100000:2.0:1790391641.608640:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391641.608651:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877361186535424:0@lo:400:kworker.0 00000100:00100000:2.0:1790391641.608670:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391641.608699:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b9e2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1877361186535936:0@lo:400:kworker.0 00000100:00100000:2.0:1790391641.608713:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391641.608725:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1790391641.608729:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7791f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186534784:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790391641.608741:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391641.608763:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186535296:0@lo:400:kworker.0 00000100:00100000:2.0:1790391641.608776:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391641.608785:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b9e2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1877361186535808:0@lo:400:kworker.0 00000100:00100000:2.0:1790391641.608796:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391641.608814:0:20339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186534912 00000100:00100000:2.0:1790391641.608820:0:20339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186534912 00000100:00100000:3.0:1790391641.608842:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186534656:0@lo:400:kworker.0 00000100:00100000:2.0:1790391641.608860:0:20339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186535424 00000100:00100000:2.0:1790391641.608864:0:20339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186535424 00000100:00100000:3.0:1790391641.608902:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391641.608911:0:20339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186535936 00000100:00100000:2.0:1790391641.608915:0:20339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186535936 00000100:00100000:3.0:1790391641.608932:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183828380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186535168:0@lo:400:kworker.0 00000100:00100000:2.0:1790391641.608940:0:20339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186535808 00000100:00100000:2.0:1790391641.608944:0:20339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186535808 00000100:00100000:2.0:1790391641.608961:0:20339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1790391641.608966:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391641.608972:0:20339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877361186534912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391641.608990:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1877361186535680:0@lo:400:kworker.0 00000100:00100000:2.0:1790391641.609019:0:20339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877361186534912:12345-0@lo:400:kworker.0 Request processed in 49us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391641.609025:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391641.609031:0:20339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1790391641.609045:0:20339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186535680 00000100:00100000:3.0:1790391641.609048:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1790391641.609049:0:20339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186535680 00000100:00100000:3.0:1790391641.609066:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186534528:0@lo:400:kworker.0 00000100:00100000:2.0:1790391641.609080:0:20339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1790391641.609089:0:20339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7792300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877361186535424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391641.609114:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391641.609122:0:20339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7792300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877361186535424:12345-0@lo:400:kworker.0 Request processed in 34us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391641.609127:0:20339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1790391641.609137:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186535040:0@lo:400:kworker.0 00000100:00100000:2.0:1790391641.609141:0:20339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1790391641.609148:0:20339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877361186535936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391641.609174:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391641.609177:0:20339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877361186535936:12345-0@lo:400:kworker.0 Request processed in 28us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391641.609193:0:20339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790391641.609200:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1877361186535552:0@lo:400:kworker.0 00000100:00100000:2.0:1790391641.609210:0:20339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1790391641.609218:0:20339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7792d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877361186535808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391641.609226:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391641.609252:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186535296 00000100:00100000:2.0:1790391641.609252:0:20339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7792d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877361186535808:12345-0@lo:400:kworker.0 Request processed in 36us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391641.609258:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186535296 00000100:00100000:2.0:1790391641.609260:0:20339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1790391641.609270:0:20339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186535552 00000100:00100000:2.0:1790391641.609273:0:20339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186535552 00000100:00100000:2.0:1790391641.609288:0:20339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1790391641.609291:0:20339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b9e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877361186535680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391641.609312:0:20339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b9e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877361186535680:12345-0@lo:400:kworker.0 Request processed in 20us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391641.609315:0:20339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1790391641.609321:0:20339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1790391641.609326:0:20339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b9e2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877361186535552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391641.609350:0:20339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b9e2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877361186535552:12345-0@lo:400:kworker.0 Request processed in 23us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391641.609356:0:20339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1790391641.609364:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186534656 00000100:00100000:3.0:1790391641.609369:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186534656 00000100:00080000:2.0:1790391641.609375:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790391641.609382:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790391641.609385:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790391641.609386:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790391641.609395:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186535168 00000100:00100000:3.0:1790391641.609399:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186535168 00000100:00100000:2.0:1790391641.609413:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1877361186535552:0@lo:400:kworker.0 00000100:00100000:3.0:1790391641.609426:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1790391641.609428:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183829c00 x1877361186535680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391641.609436:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7793b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186535296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391641.609450:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1877361186535680:0@lo:400:kworker.0 00000100:00080000:2.0:1790391641.609469:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790391641.609481:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186535296:0@lo:400:kworker.0 00000100:00100000:2.0:1790391641.609493:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b9e2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1877361186535808:0@lo:400:kworker.0 00000100:00100000:3.0:1790391641.609496:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7793b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186535296:12345-0@lo:400:kworker.0 Request processed in 58us (714us total) trans 0 rc 0/0 00010000:00080000:2.0:1790391641.609501:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52b9e2fb80 x1877361186535936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391641.609508:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790391641.609513:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b9e2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1877361186535936:0@lo:400:kworker.0 00000100:00100000:2.0:1790391641.609523:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183828e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877361186534912:0@lo:400:kworker.0 00000100:00100000:3.0:1790391641.609530:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790391641.609531:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877361186535424:0@lo:400:kworker.0 00000100:00100000:3.0:1790391641.609542:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b9e2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186534656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391641.609577:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186534272 00000100:00100000:2.0:1790391641.609580:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186534272 00000100:00100000:3.0:1790391641.609587:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b9e2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186534656:12345-0@lo:400:kworker.0 Request processed in 47us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391641.609595:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790391641.609601:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186534784 00000100:00100000:2.0:1790391641.609604:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186534784 00000100:00100000:3.0:1790391641.609613:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790391641.609616:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790391641.609623:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b9e2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186535168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391641.609626:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186534272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790391641.609649:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1790391641.609662:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b9e2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186535168:12345-0@lo:400:kworker.0 Request processed in 42us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391641.609669:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790391641.609680:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186534272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (1397us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391641.609685:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790391641.609697:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790391641.609701:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7793100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186534784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790391641.609708:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1790391641.609709:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186534528 00000100:00100000:3.0:1790391641.609714:0:18189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186534528 00000100:00100000:2.0:1790391641.609739:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7793100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186534784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391641.609743:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790391641.609750:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186535040 00000100:00100000:3.0:1790391641.609754:0:18189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186535040 00000100:00080000:2.0:1790391641.609757:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790391641.609775:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790391641.609783:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186534272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790391641.609785:0:18189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b9e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186534528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391641.609818:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7791f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186534784:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790391641.609832:0:18189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b9e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186534528:12345-0@lo:400:kworker.0 Request processed in 49us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391641.609840:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790391641.609857:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790391641.609865:0:18189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b9e2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186535040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391641.609867:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186534528:0@lo:400:kworker.0 00000100:00100000:2.0:1790391641.609902:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186534656:0@lo:400:kworker.0 00000100:00100000:2.0:1790391641.609911:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183828380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186535168:0@lo:400:kworker.0 00000100:00100000:3.0:1790391641.609928:0:18189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b9e2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186535040:12345-0@lo:400:kworker.0 Request processed in 63us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391641.609932:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186535040:0@lo:400:kworker.0 00000100:00100000:3.0:1790391641.609942:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790391641.610203:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186534400 00000100:00100000:1.0:1790391641.610207:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186534400 00000100:00100000:1.0:1790391641.610240:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1790391641.610245:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+24:3640:x1877361186534400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391641.610278:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+24:3640:x1877361186534400:12345-0@lo:400:kworker.0 Request processed in 32us (1695us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391641.610282:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1790391641.610758:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3640:1877361186534400:0@lo:400:kworker.0 00010000:00010000:0.0:1790391641.611387:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391642.632264:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391643.526807:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391643.526844:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391643.526864:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391643.526963:0:20339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169677568 00000100:00100000:2.0:1790391643.526972:0:20339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169677568 00000100:00100000:2.0:1790391643.527027:0:20339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169677440 00000100:00100000:2.0:1790391643.527030:0:20339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169677440 00000100:00100000:2.0:1790391643.527045:0:20339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 93 00000100:00100000:2.0:1790391643.527052:0:20339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b9e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:957e4510-6da1-45ee-bf96-cb07984ae4a9+5:2382:x1877361169677568:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391643.527143:0:20339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b9e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:957e4510-6da1-45ee-bf96-cb07984ae4a9+5:2382:x1877361169677568:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 91us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391643.527151:0:20339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 93 00000100:00100000:2.0:1790391643.527168:0:20339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 94 00000100:00100000:2.0:1790391643.527174:0:20339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b9e2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:957e4510-6da1-45ee-bf96-cb07984ae4a9+6:2382:x1877361169677440:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391643.527200:0:20339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b9e2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:957e4510-6da1-45ee-bf96-cb07984ae4a9+6:2382:x1877361169677440:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 26us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391643.527227:0:20339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 94 00000100:00080000:3.0:1790391643.527869:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790391643.527910:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790391643.528091:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169677312 00000100:00100000:1.0:1790391643.528097:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169677312 00000100:00100000:1.0:1790391643.528139:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 173 00000100:00100000:1.0:1790391643.528147:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de820afa-b30f-4af2-bd45-eaefa881a982+10:2382:x1877361169677312:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391643.528195:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de820afa-b30f-4af2-bd45-eaefa881a982+10:2382:x1877361169677312:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 48us (1411us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391643.528201:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 173 00010000:00010000:2.0:1790391643.659650:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391643.659680:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186536064:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790391643.659774:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391643.659936:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790391643.659945:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b9e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186536192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790391643.659973:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391643.660002:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186536064 00000100:00100000:3.0:1790391643.660009:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186536064 00000100:00100000:3.0:1790391643.660051:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186536192 00000100:00100000:3.0:1790391643.660065:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186536192 00000100:00100000:3.0:1790391643.660086:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790391643.660096:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186536064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790391643.660179:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00080000:1.0:1790391643.660217:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790391643.660227:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186536064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 131us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391643.660236:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790391643.660257:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790391643.660264:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b9e2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186536192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790391643.660274:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1790391643.660297:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b9e2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186536192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391643.660302:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790391643.660357:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b9e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186536192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790391643.660374:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186536064:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790391644.169445:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186536320:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790391644.169566:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391644.169645:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790391644.169652:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7791f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186536448:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790391644.169704:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391644.169762:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186536320 00000100:00100000:3.0:1790391644.169769:0:18189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186536320 00000100:00100000:3.0:1790391644.169826:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186536448 00000100:00100000:3.0:1790391644.169829:0:18189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186536448 00000100:00100000:3.0:1790391644.169846:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790391644.169853:0:18189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b9e2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186536320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790391644.169917:0:18189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1790391644.169962:0:18189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b9e2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186536320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391644.169976:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790391644.169994:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790391644.170000:0:18189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b9e2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186536448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790391644.170031:0:18189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1790391644.170081:0:18189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b9e2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186536448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391644.170087:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790391644.170130:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7791f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186536448:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790391644.170143:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186536320:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1790391644.686207:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391644.784276:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391644.784321:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391644.784355:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391644.784434:0:20226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169677696 00000100:00100000:2.0:1790391644.784445:0:20226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169677696 00000100:00100000:0.0:1790391644.784461:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169677952 00000100:00100000:0.0:1790391644.784467:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169677952 00000100:00100000:0.0:1790391644.784587:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169677824 00000100:00100000:0.0:1790391644.784592:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169677824 00000100:00100000:2.0:1790391644.792150:0:20226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 6 00000100:00100000:2.0:1790391644.792178:0:20226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b9e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de820afa-b30f-4af2-bd45-eaefa881a982+12:2383:x1877361169677952:12345-192.168.202.28@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790391644.792200:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 7 00010000:00010000:2.0:1790391644.792203:0:20226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790391644.792215:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b9e2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de820afa-b30f-4af2-bd45-eaefa881a982+12:2383:x1877361169677696:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391644.792227:0:17187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391644.792233:0:20226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5295144800/0x2b1b7949f13e2601 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b05c9 expref: 12 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391644.792241:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e518309c200/0x2b1b7949f13e25bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0559 expref: 12 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391644.792256:0:20226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790391644.792276:0:17187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391644.792332:0:20226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b9e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de820afa-b30f-4af2-bd45-eaefa881a982+10:2383:x1877361169677952:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 166us (8008us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391644.792341:0:20226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 6 00000100:00100000:2.0:1790391644.792364:0:20226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 8 00000100:00100000:2.0:1790391644.792370:0:20226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b9e2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de820afa-b30f-4af2-bd45-eaefa881a982+9:2383:x1877361169677824:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391644.792379:0:20226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391644.792388:0:20226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5280031800/0x2b1b7949f13e25c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b058a expref: 9 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391644.792397:0:20226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391644.792543:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b9e2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de820afa-b30f-4af2-bd45-eaefa881a982+8:2383:x1877361169677696:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 332us (8281us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391644.792551:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 7 00000100:00100000:2.0:1790391644.793833:0:20226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b9e2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de820afa-b30f-4af2-bd45-eaefa881a982+7:2383:x1877361169677824:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 1452us (9466us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391644.793844:0:20226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 8 00000100:00100000:1.0:1790391644.794431:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391644.794520:0:20339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169678208 00000100:00100000:2.0:1790391644.794529:0:20339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169678208 00000100:00100000:2.0:1790391644.795285:0:20339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 69 00000100:00100000:2.0:1790391644.795299:0:20339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:957e4510-6da1-45ee-bf96-cb07984ae4a9+6:2380:x1877361169678208:12345-192.168.202.28@tcp:39:umount.0 00000020:00000080:2.0:1790391644.795340:0:20339:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e25d0 00000020:00010000:2.0:1790391644.795347:0:20339:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9e51810c2800: total 0 00000100:00080000:2.0:1790391644.795353:0:20339:0:(import.c:65:import_set_state_nolock()) ffff9e51810c7800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790391644.795377:0:20339:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00100000:2.0:1790391644.795610:0:20339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:957e4510-6da1-45ee-bf96-cb07984ae4a9+5:2380:x1877361169678208:12345-192.168.202.28@tcp:39:umount.0 Request processed in 314us (1182us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1790391644.795619:0:20339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 69 00000020:00010000:3.0:1790391644.796097:0:17191:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9e51810c2800: total 0 00010000:00010000:3.0:1790391644.796161:0:17191:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e51810c2800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1790391644.796197:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5283a48c00) 00010000:00010000:3.0:1790391644.796201:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790391644.796212:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087a00/0x2b1b7949f13e26c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b05f3 expref: 4 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391644.796237:0:17191:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e51810c2800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1790391644.796251:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391644.796253:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391644.796255:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391644.818959:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391644.819391:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169678336 00000100:00100000:2.0:1790391644.819402:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169678336 00000100:00100000:2.0:1790391644.819464:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 70 00000100:00100000:2.0:1790391644.819475:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:957e4510-6da1-45ee-bf96-cb07984ae4a9+5:2380:x1877361169678336:12345-192.168.202.28@tcp:39:umount.0 00000020:00000080:2.0:1790391644.819514:0:17202:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e25d7 00000100:00080000:2.0:1790391644.819524:0:17202:0:(import.c:65:import_set_state_nolock()) ffff9e51810c0000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790391644.819553:0:17202:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00010000:00010000:1.0:1790391644.819839:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391644.819972:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:957e4510-6da1-45ee-bf96-cb07984ae4a9+3:2380:x1877361169678336:12345-192.168.202.28@tcp:39:umount.0 Request processed in 497us (1023us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1790391644.819981:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 70 00000100:00100000:1.0:1790391644.902433:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391644.902544:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169678592 00000100:00100000:2.0:1790391644.902554:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169678592 00000100:00100000:2.0:1790391644.902773:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 174 00000100:00100000:2.0:1790391644.902785:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de820afa-b30f-4af2-bd45-eaefa881a982+7:2380:x1877361169678592:12345-192.168.202.28@tcp:251:umount.0 00000020:00000080:2.0:1790391644.902833:0:17197:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e256e 00000020:00010000:2.0:1790391644.902841:0:17197:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9e51810c4000: total 0 00000100:00080000:2.0:1790391644.902846:0:17197:0:(import.c:65:import_set_state_nolock()) ffff9e51810c4800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1790391644.902954:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de820afa-b30f-4af2-bd45-eaefa881a982+3:2380:x1877361169678592:12345-192.168.202.28@tcp:251:umount.0 Request processed in 171us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391644.902976:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 174 00000020:00010000:3.0:1790391644.903215:0:17191:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9e51810c4000: total 0 00010000:00010000:3.0:1790391644.903220:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391644.903336:0:17191:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e51810c4000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1790391644.903381:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5280030600/0x2b1b7949f13e2575 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b04e2 expref: 2 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391644.903399:0:17191:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e51810c4000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1790391644.903411:0:17191:0:(genops.c:885:class_export_put()) final put ffff9e51810c4000/de820afa-b30f-4af2-bd45-eaefa881a982 00010000:00010000:3.0:1790391644.903434:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391644.903436:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391644.903438:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790391644.903493:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e51810c4000/de820afa-b30f-4af2-bd45-eaefa881a982 for MGS 00000020:00000080:0.0:1790391644.903543:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e51810c4800 for MGS 00000040:00080000:1.0:1790391645.256114:0:17237:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1790391645.256125:0:17237:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790391645.256162:0:17237:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1790391645.256169:0:17237:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1790391645.704156:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391646.728278:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391646.728386:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790391646.728407:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186536576:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790391646.728471:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391646.728537:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186536576 00000100:00100000:0.0:1790391646.728546:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186536576 00000100:00100000:0.0:1790391646.728596:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790391646.728606:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186536576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790391646.728633:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790391646.728677:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186536576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391646.728684:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790391646.728730:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186536576:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1790391646.728941:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790391646.728952:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186536704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790391646.728981:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391646.729010:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186536704 00000100:00100000:1.0:1790391646.729014:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186536704 00000100:00100000:1.0:1790391646.729056:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790391646.729062:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186536704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790391646.729072:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1790391646.729101:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186536704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391646.729107:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1790391646.729124:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790391646.729142:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186536704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790391646.734315:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7791f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3639:1877361186536832:0@lo:400:kworker.0 00000100:00100000:2.0:1790391646.734387:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391646.734425:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183828380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186537344:0@lo:400:kworker.0 00000100:00100000:2.0:1790391646.734492:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391646.734515:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183828e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1877361186537856:0@lo:400:kworker.0 00000100:00100000:2.0:1790391646.734540:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391646.734563:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1790391646.734569:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7791c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186536960:0@lo:400:kworker.0 00000100:00100000:2.0:1790391646.734591:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391646.734605:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186537472:0@lo:400:kworker.0 00000100:00100000:2.0:1790391646.734627:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391646.734644:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1877361186537984:0@lo:400:kworker.0 00000100:00100000:2.0:1790391646.734663:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391646.734699:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186536832 00000100:00100000:2.0:1790391646.734707:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186536832 00000100:00100000:2.0:1790391646.734759:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1790391646.734768:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+24:3639:x1877361186536832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391646.734814:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+24:3639:x1877361186536832:12345-0@lo:400:kworker.0 Request processed in 47us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391646.734821:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1790391646.734852:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186537344 00000100:00100000:2.0:1790391646.734855:0:18189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186537344 00000100:00100000:2.0:1790391646.734905:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186536960 00000100:00100000:2.0:1790391646.734915:0:18189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186536960 00000100:00100000:2.0:1790391646.734933:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790391646.734938:0:18189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186537344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391646.734973:0:18189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186537344:12345-0@lo:400:kworker.0 Request processed in 35us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391646.734979:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790391646.734990:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790391646.734995:0:18189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186536960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391646.735020:0:18189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186536960:12345-0@lo:400:kworker.0 Request processed in 25us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391646.735037:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790391646.735055:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186537856 00000100:00100000:2.0:1790391646.735058:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186537856 00000100:00100000:2.0:1790391646.735092:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186537984 00000100:00100000:2.0:1790391646.735094:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186537984 00000100:00100000:2.0:1790391646.735111:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790391646.735117:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877361186537856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391646.735144:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877361186537856:12345-0@lo:400:kworker.0 Request processed in 28us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391646.735149:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790391646.735159:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790391646.735164:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1877361186537984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391646.735188:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1877361186537984:12345-0@lo:400:kworker.0 Request processed in 24us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391646.735193:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790391646.735214:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186537472 00000100:00100000:2.0:1790391646.735218:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186537472 00000100:00100000:2.0:1790391646.735250:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790391646.735256:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186537472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391646.735285:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186537472:12345-0@lo:400:kworker.0 Request processed in 29us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391646.735291:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790391646.735342:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7791c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186536960:0@lo:400:kworker.0 00000100:00100000:2.0:1790391646.735352:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186537472:0@lo:400:kworker.0 00000100:00100000:2.0:1790391646.735359:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1877361186537984:0@lo:400:kworker.0 00000100:00100000:2.0:1790391646.735366:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7791f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3639:1877361186536832:0@lo:400:kworker.0 00000100:00100000:2.0:1790391646.735374:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183828380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186537344:0@lo:400:kworker.0 00010000:00080000:2.0:1790391646.735384:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183828e00 x1877361186537856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391646.735392:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183828e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1877361186537856:0@lo:400:kworker.0 00000001:00100000:0.0:1790391646.736555:0:17934:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 957e4510-6da1-45ee-bf96-cb07984ae4a9 00000001:00080000:0.0:1790391646.736572:0:17934:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:0.0:1790391646.736577:0:17934:0:(genops.c:885:class_export_put()) final put ffff9e51810c5800/957e4510-6da1-45ee-bf96-cb07984ae4a9 00000001:00100000:0.0:1790391646.736596:0:17934:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 89b7dd42-ca89-4c21-9061-6e0347f78f2b 00000001:00080000:0.0:1790391646.736603:0:17934:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:0.0:1790391646.736605:0:17934:0:(genops.c:885:class_export_put()) final put ffff9e5182ddb800/89b7dd42-ca89-4c21-9061-6e0347f78f2b 00000020:00000080:2.0:1790391646.736640:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e51810c5800/957e4510-6da1-45ee-bf96-cb07984ae4a9 for lustre-MDT0001 00000020:00000080:2.0:1790391646.736695:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5182ddb800/89b7dd42-ca89-4c21-9061-6e0347f78f2b for lustre-MDT0001 00000020:00000080:2.0:1790391646.736724:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e51810c0000 for lustre-MDT0001 00000020:00000080:2.0:1790391646.736730:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5182ddb000 for lustre-MDT0001 00000001:00100000:2.0:1790391646.738610:0:17182:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 957e4510-6da1-45ee-bf96-cb07984ae4a9 00000001:00080000:2.0:1790391646.738626:0:17182:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:2.0:1790391646.738632:0:17182:0:(genops.c:885:class_export_put()) final put ffff9e51810c2800/957e4510-6da1-45ee-bf96-cb07984ae4a9 00000001:00100000:2.0:1790391646.738653:0:17182:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 89b7dd42-ca89-4c21-9061-6e0347f78f2b 00000001:00080000:2.0:1790391646.738659:0:17182:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:2.0:1790391646.738665:0:17182:0:(genops.c:885:class_export_put()) final put ffff9e5182ddc800/89b7dd42-ca89-4c21-9061-6e0347f78f2b 00000020:00000080:0.0:1790391646.738722:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e51810c2800/957e4510-6da1-45ee-bf96-cb07984ae4a9 for lustre-MDT0000 00000020:00000080:0.0:1790391646.738791:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5182ddc800/89b7dd42-ca89-4c21-9061-6e0347f78f2b for lustre-MDT0000 00000020:00000080:0.0:1790391646.738823:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e51810c7800 for lustre-MDT0000 00000020:00000080:0.0:1790391646.738828:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5182ddf800 for lustre-MDT0000 00000100:00100000:1.0:1790391646.739595:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186537088:0@lo:400:kworker.0 00000100:00100000:1.0:1790391646.739676:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391646.739721:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186537600:0@lo:400:kworker.0 00000100:00100000:1.0:1790391646.739749:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391646.739777:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1877361186538112:0@lo:400:kworker.0 00000100:00100000:1.0:1790391646.739813:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391646.739843:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790391646.739849:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877361186537216:0@lo:400:kworker.0 00000100:00100000:1.0:1790391646.739934:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391646.739951:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1877361186537728:0@lo:400:kworker.0 00000100:00100000:1.0:1790391646.739971:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391646.739999:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186537600 00000100:00100000:1.0:1790391646.740006:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186537600 00000100:00100000:1.0:1790391646.740052:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186538112 00000100:00100000:1.0:1790391646.740055:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186538112 00000100:00100000:1.0:1790391646.740073:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186537216 00000100:00100000:1.0:1790391646.740075:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186537216 00000100:00100000:1.0:1790391646.740085:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186537728 00000100:00100000:1.0:1790391646.740087:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186537728 00000100:00100000:1.0:1790391646.740102:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790391646.740109:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186537600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391646.740160:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186537600:12345-0@lo:400:kworker.0 Request processed in 51us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391646.740167:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790391646.740181:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1790391646.740186:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518331d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1877361186538112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391646.740210:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518331d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1877361186538112:12345-0@lo:400:kworker.0 Request processed in 25us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391646.740224:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1790391646.740236:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1790391646.740241:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518331ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877361186537216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391646.740269:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518331ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877361186537216:12345-0@lo:400:kworker.0 Request processed in 28us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391646.740274:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1790391646.740285:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790391646.740290:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518331ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1877361186537728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391646.740311:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518331ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1877361186537728:12345-0@lo:400:kworker.0 Request processed in 21us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391646.740316:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790391646.740357:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877361186537216:0@lo:400:kworker.0 00000100:00100000:1.0:1790391646.740643:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1877361186537728:0@lo:400:kworker.0 00000100:00100000:1.0:1790391646.740654:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186537600:0@lo:400:kworker.0 00010000:00080000:1.0:1790391646.740666:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183829c00 x1877361186538112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391646.740676:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1877361186538112:0@lo:400:kworker.0 00000100:00080000:1.0:1790391646.740705:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790391646.740710:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790391646.740712:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790391646.740964:0:19144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186537088 00000100:00100000:2.0:1790391646.740969:0:19144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186537088 00000100:00100000:2.0:1790391646.741018:0:19144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790391646.741034:0:19144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186537088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391646.741097:0:19144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186537088:12345-0@lo:400:kworker.0 Request processed in 73us (1420us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391646.741104:0:19144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1790391646.741150:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790391646.742111:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186537088:0@lo:400:kworker.0 00000001:00100000:3.0:1790391646.754496:0:18703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 89b7dd42-ca89-4c21-9061-6e0347f78f2b 00000020:00000080:3.0:1790391646.754508:0:18703:0:(genops.c:885:class_export_put()) final put ffff9e518214c800/89b7dd42-ca89-4c21-9061-6e0347f78f2b 00000020:00000080:1.0:1790391646.755134:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e518214c800/89b7dd42-ca89-4c21-9061-6e0347f78f2b for lustre-OST0000 00000020:00000080:1.0:1790391646.755188:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5182148800 for lustre-OST0000 00000020:01000004:1.0:1790391647.617761:0:20772:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1790391647.634270:0:20772:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1790391647.634352:0:20772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee800/0x2b1b7949f13e2131 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2138 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391647.634371:0:20772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee800/0x2b1b7949f13e2131 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e2138 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391647.634380:0:20772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee800/0x2b1b7949f13e2131 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e2138 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391647.634387:0:20772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee800/0x2b1b7949f13e2131 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e2138 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391647.634544:0:20772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790391647.634552:0:20772:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1790391647.634584:0:20772:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790391647.634591:0:20772:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1790391647.634599:0:20772:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1790391647.634634:0:20772:0:(import.c:65:import_set_state_nolock()) ffff9e5284ed9800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1790391647.638674:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1877361186538240:0@lo:39:umount.0 00000100:00100000:3.0:1790391647.638783:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391647.638864:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186538240 00000100:00100000:3.0:1790391647.638895:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186538240 00000100:00100000:3.0:1790391647.638957:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790391647.638967:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b9e2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1877361186538240:12345-0@lo:39:umount.0 00000020:00000080:3.0:1790391647.639007:0:17202:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e2162 00000100:00080000:3.0:1790391647.639030:0:17202:0:(import.c:65:import_set_state_nolock()) ffff9e52b9a8e800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1790391647.641298:0:17190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391647.641311:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee800/0x2b1b7949f13e2131 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e2138 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391647.641321:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eee800 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:0.0:1790391647.641326:0:17190:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee800/0x2b1b7949f13e2131 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e2138 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391647.641361:0:17190:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee800/0x2b1b7949f13e2131 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x2b1b7949f13e2138 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790391647.641370:0:17190:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee800/0x2b1b7949f13e2131 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x2b1b7949f13e2138 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391647.641376:0:17190:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790391647.641379:0:17190:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1790391647.641384:0:17190:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1790391647.641439:0:17190:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee800/0x2b1b7949f13e2131 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e2138 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391647.641445:0:17190:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790391647.641476:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee800/0x2b1b7949f13e2131 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e2138 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391647.641484:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee800/0x2b1b7949f13e2131 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e2138 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391647.641499:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391647.641501:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391647.641503:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391647.641530:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3638:1877361186538368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790391647.641614:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391647.641699:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186538368 00000100:00100000:0.0:1790391647.641707:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186538368 00000100:00100000:0.0:1790391647.641767:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790391647.641776:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+24:3638:x1877361186538368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790391647.641787:0:17189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391647.641808:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52b5eeea00/0x2b1b7949f13e2138 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2b1b7949f13e2131 expref: 24 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391647.641819:0:17189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391647.641850:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+23:3638:x1877361186538368:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391647.641856:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790391647.641913:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3638:1877361186538368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790391647.650195:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b9e2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3636:x1877361186538240:12345-0@lo:39:umount.0 Request processed in 11215us (11398us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391647.650214:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:3.0:1790391647.650235:0:17202:0:(genops.c:885:class_export_put()) final put ffff9e52b9a8a000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:3.0:1790391647.650331:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e5284ed9800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1790391647.650349:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1877361186538240:0@lo:39:umount.0 00000020:00000080:3.0:1790391647.650390:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b9a8a000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1790391647.650451:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e52b9a8e800 for lustre-MDT0000 00010000:00010000:0.0:1790391647.650643:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790391647.652280:0:20772:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790391647.652291:0:20772:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1790391647.652299:0:20772:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1790391647.653275:0:20772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b763da00/0x2b1b7949f13e2082 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2089 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391647.653295:0:20772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b763da00/0x2b1b7949f13e2082 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e2089 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391647.653304:0:20772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b763da00/0x2b1b7949f13e2082 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e2089 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391647.653328:0:20772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.128@tcp lock: ffff9e52b763da00/0x2b1b7949f13e2082 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e2089 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391647.653354:0:20772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790391647.653362:0:20772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b763c200/0x2b1b7949f13e248e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2495 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391647.653368:0:20772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b763c200/0x2b1b7949f13e248e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e2495 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391647.653374:0:20772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b763c200/0x2b1b7949f13e248e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e2495 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391647.653380:0:20772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.128@tcp lock: ffff9e52b763c200/0x2b1b7949f13e248e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e2495 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391647.653394:0:20772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790391647.653402:0:20772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d600/0x2b1b7949f13e2639 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2640 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391647.653409:0:20772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d600/0x2b1b7949f13e2639 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e2640 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391647.653415:0:20772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d600/0x2b1b7949f13e2639 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e2640 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391647.653421:0:20772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d600/0x2b1b7949f13e2639 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e2640 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391647.653441:0:20772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1790391647.653447:0:20772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b763c800/0x2b1b7949f13e2074 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e207b expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391647.653452:0:20772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b763c800/0x2b1b7949f13e2074 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e207b expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391647.653457:0:20772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b763c800/0x2b1b7949f13e2074 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e207b expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391647.653462:0:20772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.128@tcp lock: ffff9e52b763c800/0x2b1b7949f13e2074 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e207b expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391647.653468:0:20772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1790391647.653471:0:20772:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1790391647.653506:0:20772:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1790391647.653511:0:20772:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1790391647.653517:0:20772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790391647.653524:0:20772:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/9 00000020:00080000:1.0:1790391647.653532:0:20772:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9e51810c1000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790391647.653538:0:20772:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9e52878fc800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790391647.653543:0:20772:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9e52a75c0000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790391647.653547:0:20772:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9e528493f000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790391647.653552:0:20772:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9e529e978000) has exports, disconnecting them 00000020:00080000:1.0:1790391647.653557:0:20772:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e51810c1000), last request at 1790391646 00000020:00000080:1.0:1790391647.653567:0:20772:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e245d 00000100:00080000:1.0:1790391647.653588:0:20772:0:(import.c:65:import_set_state_nolock()) ffff9e51810c6000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1790391647.653658:0:20772:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e51810c1000): rc 0 00000020:00000080:1.0:1790391647.653662:0:20772:0:(genops.c:885:class_export_put()) final put ffff9e51810c1000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1790391647.653674:0:20772:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e52878fc800), last request at 1790391646 00000020:00000080:1.0:1790391647.653678:0:20772:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e22ff 00000100:00080000:1.0:1790391647.653685:0:20772:0:(import.c:65:import_set_state_nolock()) ffff9e52878fb000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1790391647.653692:0:20772:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e52878fc800): rc 0 00000020:00000080:1.0:1790391647.653694:0:20772:0:(genops.c:885:class_export_put()) final put ffff9e52878fc800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1790391647.653699:0:20772:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e52a75c0000), last request at 1790391567 00000020:00000080:1.0:1790391647.653701:0:20772:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e2250 00000100:00080000:1.0:1790391647.653705:0:20772:0:(import.c:65:import_set_state_nolock()) ffff9e52a75c2000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1790391647.653712:0:20772:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e52a75c0000): rc 0 00000020:00000080:1.0:1790391647.653714:0:20772:0:(genops.c:885:class_export_put()) final put ffff9e52a75c0000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1790391647.653717:0:20772:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e528493f000), last request at 1790391567 00000020:00000080:1.0:1790391647.653721:0:20772:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e21f5 00000100:00080000:1.0:1790391647.653725:0:20772:0:(import.c:65:import_set_state_nolock()) ffff9e51838d0000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790391647.653733:0:20772:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000020:00080000:1.0:1790391647.653849:0:20772:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e528493f000): rc 0 00000004:00000080:1.0:1790391647.653857:0:20772:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffab8401643ae0 00000020:00000080:2.0:1790391647.659507:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e51810c1000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1790391647.659625:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52878fc800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1790391647.659661:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52a75c0000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1790391647.659693:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e51810c6000 for lustre-MDT0000 00000020:00000080:2.0:1790391647.659698:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e52878fb000 for lustre-MDT0000 00000020:00000080:2.0:1790391647.659702:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e52a75c2000 for lustre-MDT0000 00010000:00010000:2.0:1790391647.661062:0:17190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1790391647.661078:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e52b763da00/0x2b1b7949f13e2082 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e2089 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391647.661090:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763da00 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:2.0:1790391647.661095:0:17190:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e52b763da00/0x2b1b7949f13e2082 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e2089 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391647.661118:0:17190:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e52b763da00/0x2b1b7949f13e2082 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x2b1b7949f13e2089 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790391647.661126:0:17190:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e52b763da00/0x2b1b7949f13e2082 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x2b1b7949f13e2089 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391647.661132:0:17190:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790391647.661135:0:17190:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1790391647.661159:0:17190:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:2.0:1790391647.661219:0:17190:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e52b763da00/0x2b1b7949f13e2082 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e2089 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391647.661227:0:17190:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790391647.661257:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e52b763da00/0x2b1b7949f13e2082 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e2089 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391647.661265:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e52b763da00/0x2b1b7949f13e2082 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e2089 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391647.661281:0:17190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790391647.661285:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e52b763c200/0x2b1b7949f13e248e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e2495 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391647.661291:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763c200 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:2.0:1790391647.661294:0:17190:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e52b763c200/0x2b1b7949f13e248e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e2495 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391647.661302:0:17190:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e52b763c200/0x2b1b7949f13e248e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2b1b7949f13e2495 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790391647.661308:0:17190:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e52b763c200/0x2b1b7949f13e248e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2b1b7949f13e2495 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391647.661314:0:17190:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1790391647.661316:0:17190:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1790391647.661317:0:17190:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1790391647.661332:0:17190:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e52b763c200/0x2b1b7949f13e248e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e2495 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391647.661338:0:17190:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790391647.661352:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e52b763c200/0x2b1b7949f13e248e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e2495 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391647.661358:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e52b763c200/0x2b1b7949f13e248e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e2495 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391647.661372:0:17190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790391647.661376:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d600/0x2b1b7949f13e2639 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e2640 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391647.661383:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52bab9d600 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:2.0:1790391647.661386:0:17190:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d600/0x2b1b7949f13e2639 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e2640 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391647.661393:0:17190:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d600/0x2b1b7949f13e2639 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x2b1b7949f13e2640 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790391647.661400:0:17190:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d600/0x2b1b7949f13e2639 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x2b1b7949f13e2640 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391647.661406:0:17190:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1790391647.661408:0:17190:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1790391647.661411:0:17190:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1790391647.661424:0:17190:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d600/0x2b1b7949f13e2639 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e2640 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391647.661430:0:17190:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790391647.661448:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d600/0x2b1b7949f13e2639 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e2640 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391647.661455:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d600/0x2b1b7949f13e2639 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e2640 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391647.661473:0:17190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391647.661477:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e52b763c800/0x2b1b7949f13e2074 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e207b expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391647.661483:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763c800 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:2.0:1790391647.661486:0:17190:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e52b763c800/0x2b1b7949f13e2074 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e207b expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391647.661493:0:17190:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e52b763c800/0x2b1b7949f13e2074 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2b1b7949f13e207b expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790391647.661499:0:17190:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e52b763c800/0x2b1b7949f13e2074 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2b1b7949f13e207b expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391647.661505:0:17190:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1790391647.661507:0:17190:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1790391647.661509:0:17190:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1790391647.661522:0:17190:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e52b763c800/0x2b1b7949f13e2074 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e207b expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391647.661528:0:17190:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790391647.661535:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e52b763c800/0x2b1b7949f13e2074 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e207b expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391647.661541:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e52b763c800/0x2b1b7949f13e2074 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e207b expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391647.661550:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391647.661552:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391647.661559:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391647.661585:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3639:1877361186538496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790391647.661674:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391647.661738:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790391647.661744:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3639:1877361186538624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790391647.661770:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391647.661819:0:20226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186538496 00000100:00100000:2.0:1790391647.661828:0:20226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186538496 00000100:00100000:2.0:1790391647.661910:0:20226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186538624 00000100:00100000:2.0:1790391647.661913:0:20226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186538624 00000100:00100000:2.0:1790391647.661937:0:20226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790391647.661946:0:20226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183828700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f157595d-6a80-4a0f-be35-35ee7e9fe29d+24:3639:x1877361186538496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790391647.661960:0:20226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391647.661979:0:20226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5183086200/0x2b1b7949f13e2089 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2b1b7949f13e2082 expref: 24 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391647.661992:0:20226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391647.662039:0:20226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183828700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f157595d-6a80-4a0f-be35-35ee7e9fe29d+23:3639:x1877361186538496:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391647.662046:0:20226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790391647.662062:0:20226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790391647.662067:0:20226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183329450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f157595d-6a80-4a0f-be35-35ee7e9fe29d+22:3639:x1877361186538624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790391647.662074:0:20226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391647.662081:0:20226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52b763d000/0x2b1b7949f13e2495 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2b1b7949f13e248e expref: 22 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391647.662090:0:20226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391647.662106:0:20226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183329450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f157595d-6a80-4a0f-be35-35ee7e9fe29d+21:3639:x1877361186538624:12345-0@lo:103:ldlm_bl.0 Request processed in 40us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391647.662118:0:20226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790391647.662171:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3637:1877361186538752:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790391647.662195:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391647.662215:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790391647.662220:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3637:1877361186538880:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790391647.662237:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391647.662255:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186538752 00000100:00100000:2.0:1790391647.662258:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186538752 00000100:00100000:2.0:1790391647.662277:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186538880 00000100:00100000:2.0:1790391647.662279:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186538880 00000100:00100000:2.0:1790391647.662290:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790391647.662296:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183828700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+22:3637:x1877361186538752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790391647.662302:0:17187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391647.662311:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5295144400/0x2b1b7949f13e2640 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2b1b7949f13e2639 expref: 22 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391647.662320:0:17187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391647.662343:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183828700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+21:3637:x1877361186538752:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391647.662349:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790391647.662360:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790391647.662366:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+20:3637:x1877361186538880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790391647.662372:0:17187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391647.662380:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5183087e00/0x2b1b7949f13e207b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2b1b7949f13e2074 expref: 20 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391647.662388:0:17187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391647.662414:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+19:3637:x1877361186538880:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391647.662420:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790391647.662456:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3637:1877361186538880:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790391647.662463:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3637:1877361186538752:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790391647.662496:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3639:1877361186538624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790391647.662503:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3639:1877361186538496:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790391647.664041:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790391647.664729:0:20772:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1790391647.664738:0:20772:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1790391647.667073:0:20772:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1790391647.667225:0:20772:0:(import.c:65:import_set_state_nolock()) ffff9e5284eef000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1790391647.667402:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186539008:0@lo:39:umount.0 00000100:00100000:3.0:1790391647.667527:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391647.669169:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186539008 00000100:00100000:0.0:1790391647.669183:0:18189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186539008 00000100:00100000:0.0:1790391647.669246:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790391647.669254:0:18189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b9e2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1877361186539008:12345-0@lo:39:umount.0 00000020:00000080:0.0:1790391647.669291:0:18189:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e227a 00000100:00080000:0.0:1790391647.669300:0:18189:0:(import.c:65:import_set_state_nolock()) ffff9e52b5cfd800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790391647.669329:0:18189:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1790391647.669544:0:18189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b9e2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3636:x1877361186539008:12345-0@lo:39:umount.0 Request processed in 288us (2016us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1790391647.669552:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1790391647.670219:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e5284eef000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1790391647.670230:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186539008:0@lo:39:umount.0 00010000:00010000:3.0:1790391647.670253:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790391647.672309:0:20772:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1790391647.672320:0:20772:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:1.0:1790391647.672348:0:20772:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1790391647.672409:0:20772:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1790391647.672441:0:20772:0:(import.c:65:import_set_state_nolock()) ffff9e5183375000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1790391647.672463:0:20772:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1790391647.672479:0:20772:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:1.0:1790391647.672496:0:20772:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790391647.672522:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186539136:0@lo:9:umount.0 00000100:00080000:1.0:1790391647.672554:0:20772:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1790391647.672566:0:20772:0:(import.c:65:import_set_state_nolock()) ffff9e5183835000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1790391647.672623:0:20772:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9e529e978000) has no exports 00000100:00100000:3.0:1790391647.673289:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391647.673451:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186539264:0@lo:9:umount.0 00000100:00100000:3.0:1790391647.673479:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391647.674238:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186539136 00000100:00100000:2.0:1790391647.674252:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186539136 00000100:00100000:2.0:1790391647.674320:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186539264 00000100:00100000:2.0:1790391647.674324:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186539264 00000100:00100000:2.0:1790391647.674355:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790391647.674366:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b9e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1877361186539136:12345-0@lo:9:umount.0 00000020:00000080:2.0:1790391647.674404:0:18709:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e2345 00000100:00080000:2.0:1790391647.674415:0:18709:0:(import.c:65:import_set_state_nolock()) ffff9e52b5fb3800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1790391647.674563:0:20517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790391647.674575:0:20517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b9e2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3636:x1877361186539264:12345-0@lo:9:umount.0 00000020:00000080:3.0:1790391647.674591:0:20517:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e249c 00000100:00080000:3.0:1790391647.674597:0:20517:0:(import.c:65:import_set_state_nolock()) ffff9e5182096800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790391647.674636:0:20517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1790391647.674852:0:20517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b9e2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3636:x1877361186539264:12345-0@lo:9:umount.0 Request processed in 279us (1370us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391647.674859:0:20517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1790391647.674937:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e5183835000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1790391647.674953:0:3636:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1790391647.674955:0:3636:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790391647.674959:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186539264:0@lo:9:umount.0 00010000:00010000:3.0:1790391647.674999:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1790391647.675059:0:18709:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1790391647.675270:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b9e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3636:x1877361186539136:12345-0@lo:9:umount.0 Request processed in 905us (2169us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391647.675277:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:2.0:1790391647.675299:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790391647.675348:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e5183375000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1790391647.675366:0:3636:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1790391647.675368:0:3636:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790391647.675373:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186539136:0@lo:9:umount.0 00000020:00080000:1.0:1790391647.684939:0:20772:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9e529e978000) has no exports 00010000:00010000:3.0:1790391647.752135:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790391647.761661:0:20772:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e20cf 00000020:00000080:1.0:1790391647.761684:0:20772:0:(genops.c:885:class_export_put()) final put ffff9e5284986800/lustre-QMT0000_UUID 00000020:01000000:1.0:1790391647.761794:0:20772:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1790391647.762717:0:20772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790391647.762739:0:20772:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790391647.762746:0:20772:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9e529e97b380) has no exports 00000020:00000080:0.0:1790391647.763291:0:20772:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e20c8 00000020:00000080:0.0:1790391647.763306:0:20772:0:(genops.c:885:class_export_put()) final put ffff9e5181f62800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1790391647.763632:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5284986800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1790391647.767457:0:20772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790391647.767490:0:20772:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1790391647.767499:0:20772:0:(genops.c:885:class_export_put()) final put ffff9e5181f62000/lustre-QMT0000_UUID 00000020:00000080:0.0:1790391647.767504:0:20772:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5181f62000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1790391647.767543:0:20772:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1790391647.772558:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5181f62800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:3.0:1790391648.776255:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186539392:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790391648.776344:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391648.776450:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186539392 00000100:00100000:1.0:1790391648.776458:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186539392 00000100:00100000:1.0:1790391648.776522:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790391648.776532:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b9e2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186539392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790391648.776565:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00010000:00010000:2.0:1790391648.776732:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790391648.776760:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790391648.780316:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b9e2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186539392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3773us (3960us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391648.780330:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790391648.781295:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186539392:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790391649.288784:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790391649.292663:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186539520:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790391649.292747:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391649.292929:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186539520 00000100:00100000:2.0:1790391649.292938:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186539520 00000100:00100000:2.0:1790391649.292988:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790391649.292995:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b9e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1877361186539520:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1790391649.293030:0:17206:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1790391649.293221:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b9e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1877361186539520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 225us (474us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790391649.293314:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:02020000:3.0:1790391649.293413:0:3639:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1790391649.299311:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1790391649.299320:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9e528765d000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1790391649.299324:0:3639:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1790391649.324336:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9e528765d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790391649.324350:0:3639:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 480 00000100:00080000:3.0:1790391649.324361:0:3639:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9e528765d000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:3.0:1790391649.324405:0:3639:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e52b9e2f800 x1877361186539648/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790391649.328409:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b9e2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186539648:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1790391649.328491:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391649.328718:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186539648 00000100:00100000:3.0:1790391649.328726:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186539648 00000100:00100000:3.0:1790391649.328769:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790391649.328777:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1877361186539648:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1790391649.328794:0:17207:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1790391649.335976:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1877361186539648:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 7189us (7476us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790391649.335991:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:3.0:1790391649.336598:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e528765d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790391649.336605:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790391649.336624:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b9e2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186539648:0@lo:38:ptlrpcd_00_02.0 00000040:00080000:2.0:1790391649.352584:0:17954:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790391649.802423:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391650.824167:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391651.848154:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186539776:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790391651.848258:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790391651.848445:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790391651.848453:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790391651.848456:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e528765d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790391651.848464:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 562 00000100:00080000:2.0:1790391651.848471:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790391651.848478:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9e528765d000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:2.0:1790391651.848500:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5183828e00 x1877361186540032/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790391651.848659:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186539776 00000100:00100000:0.0:1790391651.848668:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186539776 00000100:00100000:0.0:1790391651.848729:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790391651.848739:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518331e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186539776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790391651.848768:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790391651.848837:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518331e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186539776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391651.848844:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:0.0:1790391651.848864:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391651.848897:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877361186540288:0@lo:400:kworker.0 00000100:00100000:0.0:1790391651.848933:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391651.848956:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7791f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1877361186540800:0@lo:400:kworker.0 00000100:00100000:0.0:1790391651.848986:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391651.849014:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1790391651.849020:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183828380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186540160:0@lo:400:kworker.0 00000100:00100000:0.0:1790391651.849044:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391651.849063:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1877361186540672:0@lo:400:kworker.0 00000100:00100000:0.0:1790391651.849082:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391651.849106:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186540288 00000100:00100000:0.0:1790391651.849109:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186540288 00000100:00100000:0.0:1790391651.849127:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186540800 00000100:00100000:0.0:1790391651.849129:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186540800 00000100:00100000:0.0:1790391651.849145:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186540672 00000100:00100000:0.0:1790391651.849147:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186540672 00000100:00100000:0.0:1790391651.849157:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1790391651.849174:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877361186540800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391651.849210:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877361186540800:12345-0@lo:400:kworker.0 Request processed in 37us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391651.849217:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1790391651.849230:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790391651.849233:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1877361186540288:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1790391651.849238:0:17203:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1790391651.849262:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1877361186540288:12345-0@lo:400:kworker.0 Request processed in 27us (329us total) trans 0 rc -107/-107 00000100:00100000:0.0:1790391651.849268:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790391651.849279:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790391651.849283:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1877361186540672:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1790391651.849287:0:17203:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1790391651.849310:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1877361186540672:12345-0@lo:400:kworker.0 Request processed in 25us (226us total) trans 0 rc -107/-107 00000100:00100000:0.0:1790391651.849316:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790391651.849337:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186540160 00000100:00100000:0.0:1790391651.849341:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186540160 00000100:00100000:0.0:1790391651.849383:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790391651.849391:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186540160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391651.849425:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186540160:12345-0@lo:400:kworker.0 Request processed in 36us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391651.849439:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790391651.849441:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183828e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186540032:0@lo:38:kworker.0 00000100:00100000:0.0:1790391651.849485:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183828380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186540160:0@lo:400:kworker.0 00000100:00080000:0.0:1790391651.849503:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1790391651.849507:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9e52b5cb9800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:3.0:1790391651.849521:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:02000400:0.0:1790391651.849526:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1790391651.849593:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186540032 00000100:00100000:3.0:1790391651.849606:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186540032 00000100:00100000:3.0:1790391651.849647:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790391651.849655:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b9e2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1877361186540032:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1790391651.849666:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3638:1877361186539904:0@lo:400:kworker.0 00010000:02000000:3.0:1790391651.849677:0:17206:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1790391651.849717:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391651.849759:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1877361186540544:0@lo:400:kworker.0 00000100:00100000:1.0:1790391651.849797:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391651.849826:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790391651.849833:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1877361186540416:0@lo:400:kworker.0 00000100:00100000:1.0:1790391651.849854:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391651.849913:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186540544 00000100:00100000:1.0:1790391651.849924:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186540544 00000100:00100000:1.0:1790391651.849954:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186540416 00000100:00100000:1.0:1790391651.849956:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186540416 00000100:00100000:1.0:1790391651.849973:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790391651.849995:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518331df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877361186540544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391651.850040:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518331df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877361186540544:12345-0@lo:400:kworker.0 Request processed in 61us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391651.850046:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790391651.850064:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790391651.850068:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518331d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1877361186540416:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1790391651.850072:0:17202:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1790391651.850099:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518331d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1877361186540416:12345-0@lo:400:kworker.0 Request processed in 29us (244us total) trans 0 rc -107/-107 00000100:00100000:1.0:1790391651.850104:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1790391651.850141:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1790391651.850144:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9e5182dd9800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1790391651.850154:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1790391651.850158:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9e5182dd9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790391651.850162:0:3638:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 497 00000100:00080000:1.0:1790391651.850166:0:3638:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e5182dd9800 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:1.0:1790391651.850192:0:3638:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e518331f100 x1877361186540928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790391651.850220:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1877361186540416:0@lo:400:kworker.0 00010000:00080000:1.0:1790391651.850233:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52bfa2d500 x1877361186540544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391651.850261:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1877361186540544:0@lo:400:kworker.0 00000100:00100000:1.0:1790391651.850308:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186539776:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1790391651.850772:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790391651.850779:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790391651.850781:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790391651.850802:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186539904 00000100:00100000:2.0:1790391651.850807:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186539904 00000100:00100000:2.0:1790391651.850864:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1790391651.850873:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+19:3638:x1877361186539904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391651.850942:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+19:3638:x1877361186539904:12345-0@lo:400:kworker.0 Request processed in 71us (1226us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391651.850955:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1790391651.851007:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3638:1877361186539904:0@lo:400:kworker.0 00000100:00100000:2.0:1790391651.851036:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1877361186540928:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1790391651.851061:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391651.851089:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186540928 00000100:00100000:2.0:1790391651.851093:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186540928 00000100:00100000:2.0:1790391651.851111:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790391651.851116:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7791c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1877361186540928:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:2.0:1790391651.851128:0:17202:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1790391651.851167:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7791c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1877361186540928:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 50us (105us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790391651.851181:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1790391651.851215:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e5182dd9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790391651.851220:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790391651.851230:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1877361186540928:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:0.0:1790391651.862298:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9e52b5cb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790391651.862313:0:3640:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 514 00000100:00080000:0.0:1790391651.862326:0:3640:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e52b5cb9800 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:0.0:1790391651.862384:0:3640:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5181cb9180 x1877361186541056/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790391651.862520:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1877361186541056:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1790391651.862641:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391651.862967:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1877361186540672:0@lo:400:kworker.0 00000100:00080000:0.0:1790391651.863357:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1790391651.863363:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9e529518d000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1790391651.863367:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1790391651.863371:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9e529518d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790391651.863376:0:3640:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 480 00000100:00080000:0.0:1790391651.863383:0:3640:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9e529518d000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:0.0:1790391651.863408:0:3640:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5181cb9880 x1877361186541184/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790391651.863497:0:20339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186541056 00000100:00100000:1.0:1790391651.863507:0:20339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186541056 00000100:00100000:1.0:1790391651.863572:0:20339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790391651.863581:0:20339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3636:x1877361186541056:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1790391651.863602:0:20339:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1790391651.864224:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1877361186541184:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1790391651.864386:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391651.864491:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877361186540288:0@lo:400:kworker.0 00010000:00080000:0.0:1790391651.864521:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52b7791f80 x1877361186540800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391651.864535:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7791f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1877361186540800:0@lo:400:kworker.0 00000100:00100000:0.0:1790391651.864625:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186541184 00000100:00100000:0.0:1790391651.864631:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186541184 00000100:00100000:0.0:1790391651.864666:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790391651.864672:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1877361186541184:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1790391651.864705:0:17203:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1790391651.864744:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1877361186541184:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 70us (357us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790391651.864753:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790391651.865500:0:20339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3636:x1877361186541056:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 1914us (2854us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790391651.865511:0:20339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1790391651.865641:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e52b5cb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790391651.865648:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790391651.865652:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1877361186541056:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:2.0:1790391651.865684:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e529518d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790391651.865688:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790391651.865704:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1877361186541184:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1790391651.880046:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b9e2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1877361186540032:12345-0@lo:38:kworker.0 Request processed in 30381us (30523us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790391651.880065:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1790391651.880270:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e528765d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790391651.880277:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790391651.880282:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183828e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186540032:0@lo:38:kworker.0 00010000:00010000:2.0:1790391652.872184:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790391653.387634:0:17934:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1790391653.387655:0:17934:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:0.0:1790391653.387663:0:17934:0:(genops.c:885:class_export_put()) final put ffff9e52b5cfb800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790391653.387785:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b5cfb800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000001:00100000:0.0:1790391653.395757:0:18703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790391653.395769:0:18703:0:(genops.c:885:class_export_put()) final put ffff9e52b5fb7000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790391653.396134:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e52b5cfd800 for lustre-MDT0001 00000020:00000080:1.0:1790391653.396185:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b5fb7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1790391653.396226:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e52b5fb3800 for lustre-OST0000 00000001:00100000:1.0:1790391653.396586:0:19520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790391653.396591:0:19520:0:(genops.c:885:class_export_put()) final put ffff9e5182095800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790391653.396676:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5182095800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1790391653.396721:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5182096800 for lustre-OST0001 00000001:00100000:3.0:1790391653.402605:0:17182:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1790391653.402619:0:17182:0:(genops.c:885:class_export_put()) final put ffff9e528493f000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1790391653.402701:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e528493f000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1790391653.412813:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e51838d0000 for lustre-MDT0000 00000020:01000000:1.0:1790391653.832506:0:20772:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e528733b720 - data ffff9e52a554abd0/ffff9e52b560f000 00000020:01000000:1.0:1790391653.832628:0:20772:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e52851d5780 - data ffff9e52a56e9af8/ffff9e52ba985400 00000001:00000004:1.0:1790391653.844384:0:20772:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00010000:00010000:3.0:1790391653.897126:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391653.897584:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186541312:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790391653.897658:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391653.898136:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186541312 00000100:00100000:2.0:1790391653.898145:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186541312 00000100:00080000:3.0:1790391653.898326:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790391653.898363:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790391653.898375:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518331c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186541312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790391653.898418:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1790391653.898697:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518331c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186541312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 324us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391653.898705:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790391653.902425:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186541312:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1790391653.975634:0:20772:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1790391653.975644:0:20772:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1790391653.975659:0:20772:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9e518331e300 x1877361186539008/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1790391657 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391653.975686:0:20772:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1790391653.986755:0:20772:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1790391653.986764:0:20772:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:3.0:1790391653.986851:0:20772:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790391653.986855:0:20772:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1790391654.004953:0:17225:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1790391654.004970:0:17225:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:0.0:1790391654.004981:0:17225:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1790391654.013229:0:20772:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1790391654.013238:0:20772:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:3.0:1790391654.013555:0:20772:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790391654.013567:0:20772:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1790391654.017840:0:17227:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1790391654.017849:0:17227:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:0.0:1790391654.017861:0:17227:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1790391654.020173:0:20772:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e2097 00000020:00000080:3.0:1790391654.020184:0:20772:0:(genops.c:885:class_export_put()) final put ffff9e51833de000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790391654.020818:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e51833de000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1790391654.022060:0:20772:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e20ac 00000020:00000080:3.0:1790391654.022070:0:20772:0:(genops.c:885:class_export_put()) final put ffff9e5284ee8800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1790391654.022088:0:20772:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1790391654.022093:0:20772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790391654.022102:0:20772:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790391654.022107:0:20772:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9e529e9799c0) has no exports 00000020:00000080:1.0:1790391654.022217:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5284ee8800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:3.0:1790391654.022640:0:20772:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1790391654.022651:0:20772:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e210e 00000020:00000080:3.0:1790391654.022656:0:20772:0:(genops.c:885:class_export_put()) final put ffff9e52b5ead800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1790391654.022707:0:20772:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1790391654.022712:0:20772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790391654.022718:0:20772:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1790391654.022721:0:20772:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9e52b5ef8000) has no exports 00000020:00000080:3.0:1790391654.022727:0:20772:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e2107 00000020:00000080:3.0:1790391654.022731:0:20772:0:(genops.c:885:class_export_put()) final put ffff9e5183832000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790391654.032543:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b5ead800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:3.0:1790391654.037029:0:20772:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1790391654.037038:0:20772:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1790391654.037043:0:20772:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:3.0:1790391654.037052:0:20772:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790391654.037054:0:20772:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790391654.043336:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5183832000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1790391654.051097:0:20772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790391654.051114:0:20772:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790391654.051139:0:20772:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e20f9 00000020:00000080:3.0:1790391654.051149:0:20772:0:(genops.c:885:class_export_put()) final put ffff9e5183831800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1790391654.051156:0:20772:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1790391654.051164:0:20772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790391654.051169:0:20772:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1790391654.051173:0:20772:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9e5183380000) has no exports 00000020:00000080:3.0:1790391654.051194:0:20772:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e20f2 00000020:00000080:3.0:1790391654.051198:0:20772:0:(genops.c:885:class_export_put()) final put ffff9e5183377800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790391654.051344:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5183835000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1790391654.051352:0:8:0:(genops.c:885:class_export_put()) final put ffff9e5183835800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790391654.051355:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5183835800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1790391654.051366:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790391654.051462:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5183831800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1790391654.051467:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5183377800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1790391654.052606:0:20772:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1790391654.052612:0:20772:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1790391654.052616:0:20772:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:3.0:1790391654.052624:0:20772:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790391654.052626:0:20772:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790391654.052706:0:20772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790391654.052712:0:20772:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1790391654.052730:0:20772:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1790391654.052735:0:20772:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e20e4 00000020:00000080:3.0:1790391654.052741:0:20772:0:(genops.c:885:class_export_put()) final put ffff9e5183370000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790391654.058998:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5183375000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1790391654.059014:0:8:0:(genops.c:885:class_export_put()) final put ffff9e5183374000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790391654.059017:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5183374000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1790391654.059025:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1790391654.059785:0:20772:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1790391654.061746:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5183370000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1790391654.061782:0:20772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790391654.061793:0:20772:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790391654.061798:0:20772:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff9e52b5efb380) has no exports 00000020:00000080:0.0:1790391654.061807:0:20772:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e20dd 00000020:00000080:0.0:1790391654.061815:0:20772:0:(genops.c:885:class_export_put()) final put ffff9e5284984800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790391654.064685:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5284984800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1790391654.064738:0:20772:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1790391654.064743:0:20772:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1790391654.064747:0:20772:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1790391654.064753:0:20772:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790391654.064797:0:20772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790391654.064808:0:20772:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790391654.064832:0:20772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790391654.064835:0:20772:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790391654.064840:0:20772:0:(genops.c:885:class_export_put()) final put ffff9e51833dd800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790391654.064843:0:20772:0:(genops.c:844:class_export_destroy()) destroying export ffff9e51833dd800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1790391654.064848:0:20772:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790391654.064989:0:20772:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e20b3 00000020:00000080:1.0:1790391654.064996:0:20772:0:(genops.c:885:class_export_put()) final put ffff9e5284eea800/lustre-MDD0000_UUID 00000020:01000000:1.0:1790391654.065005:0:20772:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1790391654.065008:0:20772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790391654.065028:0:20772:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1790391654.065032:0:20772:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9e529e97cd40) has no exports 00000020:00000080:1.0:1790391654.065050:0:20772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790391654.065053:0:20772:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1790391654.065057:0:20772:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e20ba 00000020:00000080:1.0:1790391654.065061:0:20772:0:(genops.c:885:class_export_put()) final put ffff9e5284eed800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1790391654.065069:0:20772:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e5284dc3000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1790391654.065073:0:20772:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e5284dc3000 3 00000020:01000004:1.0:1790391654.065076:0:20772:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e5284dc3000 from lustre-MDT0000 00000020:00000080:1.0:1790391654.065091:0:20772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790391654.065095:0:20772:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1790391654.065097:0:20772:0:(genops.c:885:class_export_put()) final put ffff9e51833d9800/lustre-MDT0000_UUID 00000020:00000080:1.0:1790391654.065098:0:20772:0:(genops.c:844:class_export_destroy()) destroying export ffff9e51833d9800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1790391654.065105:0:20772:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1790391654.065144:0:20772:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1790391654.065149:0:20772:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1790391654.065152:0:20772:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1790391654.065154:0:20772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790391654.065157:0:20772:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1790391654.065163:0:20772:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9e5287d5b000 f157595d-6a80-4a0f-be35-35ee7e9fe29d 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790391654.065167:0:20772:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9e52b9aab380) has exports, disconnecting them 00000020:00080000:1.0:1790391654.065170:0:20772:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9e5287d5b000), last request at 1790391552 00000020:00000080:1.0:1790391654.065185:0:20772:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e205f 00000020:00010000:1.0:1790391654.065187:0:20772:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9e5287d5b000: total 2 00000100:00080000:1.0:1790391654.065191:0:20772:0:(import.c:65:import_set_state_nolock()) ffff9e5287d58800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1790391654.065740:0:20772:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e5287d5b000): rc 0 00000020:00080000:1.0:1790391654.065744:0:20772:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9e52b9aab380) has no exports 00000100:00100000:1.0:1790391654.065807:0:17194:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9e52849e8e00:17194] 0 exiting: rc = 1 00000020:00000080:1.0:1790391654.065900:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5284eef000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1790391654.065906:0:8:0:(genops.c:885:class_export_put()) final put ffff9e5284985800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790391654.065908:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5284985800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1790391654.065919:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790391654.065966:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5284eea800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1790391654.065970:0:8:0:(genops.c:885:class_export_put()) final put ffff9e5284eee800/lustre-MDD0000_UUID 00000020:00000080:1.0:1790391654.065972:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5284eee800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1790391654.065975:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1790391654.066004:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5284eed800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:3.0:1790391654.066330:0:17196:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9e5182240400:17196] 1 exiting: rc = 0 00000020:00010000:1.0:1790391654.067025:0:17191:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9e5287d5b000: total 0 00010000:00010000:1.0:1790391654.067056:0:17191:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e5287d5b000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1790391654.067087:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5183086a00/0x2b1b7949f13e22c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2b1b7949f13e22b9 expref: 14 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391654.067102:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5184054a00/0x2b1b7949f13e217e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2b1b7949f13e2177 expref: 13 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391654.067118:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52b763c400/0x2b1b7949f13e241e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2b1b7949f13e2417 expref: 12 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391654.067138:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52b763c000/0x2b1b7949f13e22ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2b1b7949f13e22e3 expref: 11 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391654.067150:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5280031600/0x2b1b7949f13e2616 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2b1b7949f13e260f expref: 10 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391654.067160:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52b5eeee00/0x2b1b7949f13e223b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2b1b7949f13e2234 expref: 9 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391654.067170:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5184054e00/0x2b1b7949f13e218c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2b1b7949f13e2185 expref: 8 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391654.067181:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5280030e00/0x2b1b7949f13e2624 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2b1b7949f13e261d expref: 7 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391654.067203:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52b5eef400/0x2b1b7949f13e219a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2b1b7949f13e2193 expref: 6 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391654.067223:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5183086c00/0x2b1b7949f13e2448 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2b1b7949f13e2441 expref: 5 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391654.067232:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5184055e00/0x2b1b7949f13e206d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2b1b7949f13e2066 expref: 4 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391654.067245:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52b763de00/0x2b1b7949f13e2487 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2b1b7949f13e2480 expref: 3 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391654.067257:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52bab9d400/0x2b1b7949f13e2632 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2b1b7949f13e262b expref: 2 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391654.067267:0:17191:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e5287d5b000, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1790391654.067280:0:17191:0:(genops.c:885:class_export_put()) final put ffff9e5287d5b000/f157595d-6a80-4a0f-be35-35ee7e9fe29d 00010000:00010000:1.0:1790391654.067300:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391654.067302:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391654.067304:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790391654.067340:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5287d5b000/f157595d-6a80-4a0f-be35-35ee7e9fe29d for MGS 00000020:00000080:3.0:1790391654.067374:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5287d58800 for MGS 00000100:00100000:2.0:1790391654.070134:0:17197:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9e51833b5200:17197] 2 exiting: rc = 0 00000100:00100000:1.0:1790391654.070478:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070486:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070491:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070497:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070503:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070508:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070514:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070521:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070526:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070531:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070550:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070556:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070562:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070567:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070572:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070577:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070583:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070589:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070595:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070600:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070606:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070611:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070618:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070624:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070630:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070636:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070641:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070647:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070652:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070656:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070662:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070667:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070672:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070678:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070683:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070688:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070693:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070699:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070705:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070710:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070715:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070720:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070726:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070732:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070738:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070752:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070757:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070763:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070769:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070775:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070780:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070786:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070792:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070797:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070804:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070810:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070815:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070820:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070826:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070831:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070836:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070841:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070846:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391654.070851:0:20772:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1790391654.071509:0:20772:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e5283423a20 - data ffff9e52a56890d8/ffff9e5287203c00 00000020:01000000:1.0:1790391654.071641:0:20772:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e51823c6960 - data ffff9e52a5695870/ffff9e52b778ec00 00000020:00000080:1.0:1790391654.072068:0:20772:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e2043 00000020:00000080:1.0:1790391654.072077:0:20772:0:(genops.c:885:class_export_put()) final put ffff9e5287d59800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790391654.072093:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5287d59800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:1.0:1790391654.072105:0:20772:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e5284dc3000 from MGS, refs=2 00000020:01000004:1.0:1790391654.072108:0:20772:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e5284dc3000 2 00000020:01000004:1.0:1790391654.072112:0:20772:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e5284dc3000 from MGS 00000020:00000080:1.0:1790391654.072131:0:20772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790391654.072137:0:20772:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1790391654.072140:0:20772:0:(genops.c:885:class_export_put()) final put ffff9e5287d5b800/MGS 00000020:00000080:1.0:1790391654.072143:0:20772:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5287d5b800/MGS for MGS 00000020:01000000:1.0:1790391654.072149:0:20772:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1790391654.072210:0:20772:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1790391654.072214:0:20772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790391654.072227:0:20772:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1790391654.072232:0:20772:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9e5284ed9000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790391654.072238:0:20772:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9e52b5cab380) has exports, disconnecting them 00000020:00080000:1.0:1790391654.072243:0:20772:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9e5284ed9000), last request at 1790391552 00000020:00000080:1.0:1790391654.072247:0:20772:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e2146 00000020:00080000:1.0:1790391654.072256:0:20772:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e5284ed9000): rc 0 00000020:00000080:1.0:1790391654.072260:0:20772:0:(genops.c:885:class_export_put()) final put ffff9e5284ed9000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1790391654.072283:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5284ed9000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1790391654.163865:0:20772:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1790391654.163887:0:20772:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790391654.163892:0:20772:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1790391654.163900:0:20772:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790391654.164119:0:20772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790391654.164137:0:20772:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1790391654.164146:0:20772:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e5284dc3000 1 00000020:00000080:3.0:1790391654.164154:0:20772:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e2035 00000020:00000080:3.0:1790391654.164162:0:20772:0:(genops.c:885:class_export_put()) final put ffff9e5287d5f000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1790391654.164166:0:20772:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1790391654.164171:0:20772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790391654.164174:0:20772:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790391654.164178:0:20772:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9e51833819c0) has no exports 00000020:00000080:3.0:1790391654.167489:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5284ed9800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1790391654.167502:0:36:0:(genops.c:885:class_export_put()) final put ffff9e5183a20800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1790391654.167506:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5183a20800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1790391654.167519:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1790391654.167599:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5287d5f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1790391654.508495:0:20772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790391654.508507:0:20772:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1790391654.508512:0:20772:0:(genops.c:885:class_export_put()) final put ffff9e5284e33800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1790391654.508518:0:20772:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5284e33800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1790391654.508532:0:20772:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1790391654.508710:0:20772:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e5284e35000 00000020:02000400:3.0:1790391654.508768:0:20772:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1790391654.920426:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391655.945946:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391656.972408:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790391656.973140:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790391656.973146:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790391656.973150:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e528765d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790391656.973159:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 565 00000100:00080000:0.0:1790391656.973165:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1790391656.973172:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9e528765d000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:0.0:1790391656.973204:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5181cb8e00 x1877361186541568/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790391656.973244:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790391656.973248:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790391656.973250:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e529518d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790391656.973254:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 565 00000100:00080000:0.0:1790391656.973256:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790391656.973260:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9e529518d000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:0.0:1790391656.973271:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5181cb9180 x1877361186541952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790391656.973280:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790391656.973283:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790391656.973284:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e5182dd9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1790391656.973415:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3638:1877361186541440:0@lo:400:kworker.0 00000400:00000100:3.0:1790391656.973469:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877361186541440 offset 0 length 224: 4 00000100:00080000:0.0:1790391656.973682:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 565 00000100:00080000:0.0:1790391656.973685:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790391656.973690:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e5182dd9800 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:0.0:1790391656.973705:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5181cbb100 x1877361186542080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790391656.973736:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790391656.973740:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790391656.973741:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e52b5cb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790391656.973745:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 565 00000100:00080000:0.0:1790391656.973747:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790391656.973751:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e52b5cb9800 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:0.0:1790391656.973770:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5181cb9500 x1877361186542336/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790391656.973846:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186541568:0@lo:38:kworker.0 00000100:00100000:0.0:1790391656.974037:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391656.974062:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1877361186541952:0@lo:38:kworker.0 00000100:00100000:0.0:1790391656.974087:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391656.974103:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1877361186542080:0@lo:38:kworker.0 00000100:00100000:0.0:1790391656.974127:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391656.974142:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1877361186542336:0@lo:38:kworker.0 00000100:00100000:0.0:1790391656.974163:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391656.974208:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186541696:0@lo:400:kworker.0 00000100:00100000:0.0:1790391656.974235:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391656.974257:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790391656.974263:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186541824:0@lo:400:kworker.0 00000100:00100000:0.0:1790391656.974283:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391656.974423:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1877361186542208:0@lo:400:kworker.0 00000100:00100000:3.0:1790391656.974463:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391656.974499:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790391656.974505:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1877361186542464:0@lo:400:kworker.0 00000100:00100000:3.0:1790391656.974649:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391656.974673:0:20339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186541952 00000100:00100000:3.0:1790391656.974681:0:20339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186541952 00000100:00100000:3.0:1790391656.974706:0:20339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186542080 00000100:00100000:3.0:1790391656.974709:0:20339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186542080 00000100:00100000:3.0:1790391656.974717:0:20339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186542336 00000100:00100000:3.0:1790391656.974719:0:20339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186542336 00000100:00100000:3.0:1790391656.974728:0:20339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186542208 00000100:00100000:3.0:1790391656.974741:0:20339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186542208 00000100:00100000:3.0:1790391656.974772:0:20339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186542464 00000100:00100000:3.0:1790391656.974775:0:20339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186542464 00000100:00100000:3.0:1790391656.974792:0:20339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1790391656.974809:0:20339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bb39ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877361186542208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391656.974861:0:20339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bb39ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877361186542208:12345-0@lo:400:kworker.0 Request processed in 53us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391656.974868:0:20339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1790391656.974901:0:20339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1790391656.974908:0:20339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bb39a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1877361186542464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391656.975280:0:20339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bb39a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1877361186542464:12345-0@lo:400:kworker.0 Request processed in 371us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391656.975711:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186541568 00000100:00100000:0.0:1790391656.975717:0:18189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186541568 00000100:00100000:0.0:1790391656.975745:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1790391656.975751:0:18189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3636:x1877361186541568:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1790391656.975771:0:18189:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1790391656.976038:0:20339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1790391656.976059:0:20339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790391656.976064:0:20339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3636:x1877361186541952:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1790391656.976074:0:20339:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1790391656.976120:0:20339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3636:x1877361186541952:12345-0@lo:38:kworker.0 Request processed in 55us (2032us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790391656.976127:0:20339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790391656.976140:0:20339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790391656.976144:0:20339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3636:x1877361186542080:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1790391656.976153:0:20339:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1790391656.976178:0:20339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3636:x1877361186542080:12345-0@lo:38:kworker.0 Request processed in 33us (2050us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790391656.976183:0:20339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790391656.976194:0:20339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790391656.976198:0:20339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3636:x1877361186542336:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1790391656.976207:0:20339:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1790391656.976242:0:20339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3636:x1877361186542336:12345-0@lo:38:kworker.0 Request processed in 42us (2078us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790391656.976249:0:20339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1790391656.976266:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790391656.976410:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e529518d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790391656.976416:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790391656.976420:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1877361186541952:0@lo:38:kworker.0 00000100:00080000:3.0:1790391656.976431:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e5182dd9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790391656.976435:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790391656.976437:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1877361186542080:0@lo:38:kworker.0 00000100:00080000:3.0:1790391656.976446:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e52b5cb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790391656.976449:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790391656.976451:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1877361186542336:0@lo:38:kworker.0 00010000:00080000:3.0:1790391656.976492:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9e5181cbaa00 x1877361186542464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391656.976503:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1877361186542464:0@lo:400:kworker.0 00010000:00080000:3.0:1790391656.977485:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9e5181cb9c00 x1877361186542208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391656.977499:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1877361186542208:0@lo:400:kworker.0 00000100:00100000:2.0:1790391656.984180:0:19144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186541696 00000100:00100000:2.0:1790391656.984195:0:19144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186541696 00000100:00100000:2.0:1790391656.984261:0:19144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186541824 00000100:00100000:2.0:1790391656.984265:0:19144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186541824 00000100:00100000:2.0:1790391656.984640:0:19144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790391656.984654:0:19144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186541696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391656.984802:0:19144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186541696:12345-0@lo:400:kworker.0 Request processed in 151us (10565us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391656.984810:0:19144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790391656.984828:0:19144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790391656.984834:0:19144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186541824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391656.984863:0:19144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186541824:12345-0@lo:400:kworker.0 Request processed in 29us (10578us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391656.984900:0:19144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1790391656.985795:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790391656.985801:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790391656.988397:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186541824:0@lo:400:kworker.0 00000100:00100000:2.0:1790391656.988421:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186541696:0@lo:400:kworker.0 00000100:00100000:1.0:1790391656.990153:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790391656.990173:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186542592:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790391656.990232:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391656.990274:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186542592 00000100:00100000:1.0:1790391656.990281:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186542592 00000100:00100000:1.0:1790391656.990325:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790391656.990334:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518331c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186542592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790391656.990359:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1790391656.990396:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518331c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186542592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391656.990402:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790391656.990439:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186542592:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790391657.025575:0:18189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3636:x1877361186541568:12345-0@lo:38:kworker.0 Request processed in 49816us (51532us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790391657.025588:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1790391657.025724:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e528765d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790391657.025730:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790391657.025735:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186541568:0@lo:38:kworker.0 00010000:00010000:1.0:1790391657.996172:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1790391658.286541:0:20973:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1790391658.304389:0:20973:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1790391658.304456:0:20973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b763d800/0x2b1b7949f13e2234 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e223b expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391658.304470:0:20973:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b763d800/0x2b1b7949f13e2234 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e223b expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391658.304477:0:20973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b763d800/0x2b1b7949f13e2234 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e223b expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391658.304496:0:20973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.128@tcp lock: ffff9e52b763d800/0x2b1b7949f13e2234 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e223b expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391658.304522:0:20973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790391658.304527:0:20973:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1790391658.304550:0:20973:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790391658.304554:0:20973:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1790391658.304559:0:20973:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1790391658.304566:0:20973:0:(import.c:65:import_set_state_nolock()) ffff9e529518d000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1790391658.304570:0:20973:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790391658.304572:0:20973:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1790391658.304575:0:20973:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1790391658.305528:0:20973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5184054400/0x2b1b7949f13e2193 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e219a expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391658.305542:0:20973:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5184054400/0x2b1b7949f13e2193 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e219a expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391658.305549:0:20973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5184054400/0x2b1b7949f13e2193 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e219a expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391658.305567:0:20973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.128@tcp lock: ffff9e5184054400/0x2b1b7949f13e2193 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e219a expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391658.305585:0:20973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790391658.305595:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790391658.305600:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e52b763d800/0x2b1b7949f13e2234 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e223b expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391658.305606:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763d800 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:1.0:1790391658.305610:0:17191:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e52b763d800/0x2b1b7949f13e2234 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e223b expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391658.305617:0:17191:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e52b763d800/0x2b1b7949f13e2234 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x2b1b7949f13e223b expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391658.305624:0:17191:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e52b763d800/0x2b1b7949f13e2234 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x2b1b7949f13e223b expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391658.305629:0:17191:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790391658.305631:0:17191:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1790391658.305633:0:17191:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1790391658.305663:0:17191:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e52b763d800/0x2b1b7949f13e2234 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e223b expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391658.305669:0:17191:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790391658.305689:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e52b763d800/0x2b1b7949f13e2234 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e223b expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391658.305697:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e52b763d800/0x2b1b7949f13e2234 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e223b expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391658.305714:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391658.305717:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e5184054400/0x2b1b7949f13e2193 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e219a expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391658.305722:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5184054400 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:1.0:1790391658.305725:0:17191:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e5184054400/0x2b1b7949f13e2193 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e219a expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391658.305731:0:17191:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5184054400/0x2b1b7949f13e2193 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x2b1b7949f13e219a expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391658.305736:0:17191:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5184054400/0x2b1b7949f13e2193 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x2b1b7949f13e219a expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391658.305740:0:17191:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790391658.305741:0:17191:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:1.0:1790391658.305755:0:17191:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e5184054400/0x2b1b7949f13e2193 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e219a expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391658.305761:0:17191:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790391658.305774:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e5184054400/0x2b1b7949f13e2193 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e219a expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391658.305780:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5184054400/0x2b1b7949f13e2193 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e219a expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391658.305789:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391658.305791:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391658.305793:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391658.305816:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3640:1877361186542720:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790391658.305912:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790391658.305990:0:20973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295144e00/0x2b1b7949f13e2480 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2487 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391658.305998:0:20973:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295144e00/0x2b1b7949f13e2480 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e2487 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391658.306005:0:20973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295144e00/0x2b1b7949f13e2480 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e2487 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391658.306011:0:20973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.128@tcp lock: ffff9e5295144e00/0x2b1b7949f13e2480 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e2487 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391658.306024:0:20973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790391658.306030:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391658.306034:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e5295144e00/0x2b1b7949f13e2480 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e2487 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391658.306039:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295144e00 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:1.0:1790391658.306041:0:17191:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e5295144e00/0x2b1b7949f13e2480 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e2487 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391658.306048:0:17191:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5295144e00/0x2b1b7949f13e2480 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2b1b7949f13e2487 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391658.306053:0:17191:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5295144e00/0x2b1b7949f13e2480 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2b1b7949f13e2487 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391658.306058:0:17191:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1790391658.306065:0:17191:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1790391658.306067:0:17191:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1790391658.306083:0:17191:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e5295144e00/0x2b1b7949f13e2480 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e2487 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391658.306090:0:17191:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790391658.306096:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e5295144e00/0x2b1b7949f13e2480 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e2487 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391658.306102:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5295144e00/0x2b1b7949f13e2480 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e2487 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391658.306116:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391658.306118:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391658.306120:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391658.306130:0:20973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5280031e00/0x2b1b7949f13e262b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2632 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391658.306137:0:20973:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5280031e00/0x2b1b7949f13e262b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e2632 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391658.306143:0:20973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5280031e00/0x2b1b7949f13e262b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e2632 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391658.306148:0:20973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.128@tcp lock: ffff9e5280031e00/0x2b1b7949f13e262b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e2632 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391658.306159:0:20973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790391658.306165:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391658.306168:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e5280031e00/0x2b1b7949f13e262b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e2632 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391658.306184:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280031e00 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:1.0:1790391658.306187:0:17191:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e5280031e00/0x2b1b7949f13e262b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e2632 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391658.306193:0:17191:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5280031e00/0x2b1b7949f13e262b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2b1b7949f13e2632 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391658.306199:0:17191:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5280031e00/0x2b1b7949f13e262b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2b1b7949f13e2632 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391658.306204:0:17191:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1790391658.306205:0:17191:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1790391658.306207:0:17191:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1790391658.306222:0:17191:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e5280031e00/0x2b1b7949f13e262b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e2632 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391658.306228:0:17191:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790391658.306238:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e5280031e00/0x2b1b7949f13e262b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e2632 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391658.306244:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5280031e00/0x2b1b7949f13e262b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e2632 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391658.306252:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391658.306254:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391658.306255:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391658.306263:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790391658.306272:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3640:1877361186543104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790391658.306300:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790391658.306334:0:20973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5184054800/0x2b1b7949f13e2185 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e218c expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391658.306341:0:20973:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5184054800/0x2b1b7949f13e2185 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e218c expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391658.306348:0:20973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5184054800/0x2b1b7949f13e2185 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e218c expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391658.306354:0:20973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.128@tcp lock: ffff9e5184054800/0x2b1b7949f13e2185 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e218c expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391658.306364:0:20973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790391658.306367:0:20973:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:1.0:1790391658.306371:0:20973:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:1.0:1790391658.306393:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391658.306397:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e5184054800/0x2b1b7949f13e2185 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e218c expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391658.306404:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5184054800 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:1.0:1790391658.306406:0:17191:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e5184054800/0x2b1b7949f13e2185 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e218c expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391658.306412:0:17191:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5184054800/0x2b1b7949f13e2185 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2b1b7949f13e218c expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391658.306418:0:17191:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5184054800/0x2b1b7949f13e2185 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2b1b7949f13e218c expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391658.306423:0:17191:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1790391658.306425:0:17191:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1790391658.306433:0:17191:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1790391658.306448:0:17191:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e5184054800/0x2b1b7949f13e2185 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e218c expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391658.306454:0:17191:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790391658.306463:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e5184054800/0x2b1b7949f13e2185 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e218c expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391658.306469:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5184054800/0x2b1b7949f13e2185 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e218c expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391658.306479:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391658.306480:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391658.306482:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391658.306490:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3640:1877361186543232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790391658.306514:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1790391658.306547:0:20973:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1790391658.306552:0:20973:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1790391658.306556:0:20973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790391658.306563:0:20973:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1790391658.306568:0:20973:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9e52b9933000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790391658.306574:0:20973:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9e52878fc000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790391658.306579:0:20973:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9e52ba40cd40) has exports, disconnecting them 00000020:00080000:1.0:1790391658.306584:0:20973:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9e52b9933000), last request at 1790391656 00000020:00000080:1.0:1790391658.306591:0:20973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e2472 00000100:00080000:1.0:1790391658.306607:0:20973:0:(import.c:65:import_set_state_nolock()) ffff9e518214b000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1790391658.306640:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1790391658.306650:0:20973:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e52b9933000): rc 0 00000020:00000080:1.0:1790391658.306652:0:20973:0:(genops.c:885:class_export_put()) final put ffff9e52b9933000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1790391658.306662:0:20973:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9e52878fc000), last request at 1790391656 00000020:00000080:1.0:1790391658.306673:0:20973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e2314 00000100:00080000:1.0:1790391658.306678:0:20973:0:(import.c:65:import_set_state_nolock()) ffff9e52878fb800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1790391658.306692:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b9933000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1790391658.306732:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e518214b000 for lustre-MDT0001 00010000:00010000:1.0:1790391658.306740:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1790391658.306747:0:20973:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e52878fc000): rc 0 00000020:00000080:1.0:1790391658.306749:0:20973:0:(genops.c:885:class_export_put()) final put ffff9e52878fc000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1790391658.306759:0:20973:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffab84019a7ae0 00000020:00000080:1.0:1790391658.306770:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52878fc000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1790391658.306792:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e52878fb800 for lustre-MDT0001 00000100:00080000:1.0:1790391658.306811:0:20973:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790391658.306818:0:20973:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9e5183829500 x1877361186539520/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1790391665 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391658.306827:0:20973:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00010000:00010000:3.0:1790391658.307337:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391658.307355:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186539520:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790391658.307383:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3637:1877361186542848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790391658.307424:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391658.307457:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790391658.307463:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3637:1877361186542976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790391658.307485:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391658.307619:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186542720 00000100:00100000:3.0:1790391658.307626:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186542720 00000100:00100000:3.0:1790391658.307655:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186543104 00000100:00100000:3.0:1790391658.307658:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186543104 00000100:00100000:3.0:1790391658.307666:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186543232 00000100:00100000:3.0:1790391658.307669:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186543232 00000100:00100000:3.0:1790391658.307676:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186542848 00000100:00100000:3.0:1790391658.307677:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186542848 00000100:00100000:3.0:1790391658.307684:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186542976 00000100:00100000:3.0:1790391658.307686:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186542976 00000100:00100000:3.0:1790391658.307697:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790391658.307704:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518331d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3640:x1877361186542720:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1790391658.307709:0:17188:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790391658 with bad export cookie 3106209726489043039 00000100:00100000:2.0:1790391658.308168:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790391658.308174:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518331e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3640:x1877361186543104:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1790391658.308179:0:17189:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790391658 with bad export cookie 3106209726489043039 00000100:00100000:2.0:1790391658.308237:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518331e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3640:x1877361186543104:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (1936us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790391658.308244:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790391658.308266:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790391658.308270:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518331c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3640:x1877361186543232:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1790391658.308273:0:17189:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790391658 with bad export cookie 3106209726489043039 00000100:00100000:2.0:1790391658.308297:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518331c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3640:x1877361186543232:12345-0@lo:103:ldlm_bl.0 Request processed in 26us (1782us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790391658.308303:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790391658.308318:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790391658.308321:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bb399f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3637:x1877361186542848:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1790391658.308325:0:17189:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790391658 with bad export cookie 3106209726489043039 00000100:00080000:0.0:1790391658.308337:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.128@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1790391658.308343:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9e5182260000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1790391658.308347:0:3640:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.128@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:2.0:1790391658.308357:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bb399f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3637:x1877361186542848:12345-0@lo:103:ldlm_bl.0 Request processed in 33us (931us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790391658.308364:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790391658.308373:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790391658.308377:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183328c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3637:x1877361186542976:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1790391658.308380:0:17189:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790391658 with bad export cookie 3106209726489043039 00000100:00100000:2.0:1790391658.308418:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183328c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3637:x1877361186542976:12345-0@lo:103:ldlm_bl.0 Request processed in 39us (932us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790391658.308423:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1790391658.313784:0:20973:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1790391658.314026:0:20973:0:(import.c:65:import_set_state_nolock()) ffff9e528765d000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1790391658.317179:0:20973:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1790391658.317188:0:20973:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:1.0:1790391658.317206:0:20973:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1790391658.317281:0:20973:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1790391658.317313:0:20973:0:(import.c:65:import_set_state_nolock()) ffff9e528765e000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1790391658.317335:0:20973:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1790391658.317337:0:20973:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:1.0:1790391658.317346:0:20973:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1790391658.317409:0:20973:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1790391658.317419:0:20973:0:(import.c:65:import_set_state_nolock()) ffff9e51838d2800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1790391658.317462:0:20973:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9e52ba40cd40) has no exports 00000100:00100000:2.0:1790391658.320702:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186543360:0@lo:9:umount.0 00000100:00100000:2.0:1790391658.320765:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391658.320829:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186543488:0@lo:9:umount.0 00000100:00100000:2.0:1790391658.320847:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790391658.320913:0:3637:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.128@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:3.0:1790391658.324586:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518331d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3640:x1877361186542720:12345-0@lo:103:ldlm_bl.0 Request processed in 16877us (18670us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790391658.324599:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790391658.324697:0:19144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186543360 00000100:00100000:3.0:1790391658.324705:0:19144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186543360 00000100:00100000:3.0:1790391658.324753:0:19144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186543488 00000100:00100000:3.0:1790391658.324757:0:19144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186543488 00000100:00100000:3.0:1790391658.324781:0:19144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790391658.324788:0:19144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1877361186543360:12345-0@lo:9:umount.0 00000020:00000080:3.0:1790391658.324827:0:19144:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e233e 00000100:00080000:3.0:1790391658.324835:0:19144:0:(import.c:65:import_set_state_nolock()) ffff9e5182dde800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790391658.324915:0:19144:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1790391658.325344:0:19144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3636:x1877361186543360:12345-0@lo:9:umount.0 Request processed in 555us (4577us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391658.325351:0:19144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790391658.325367:0:19144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790391658.325374:0:19144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1877361186543488:12345-0@lo:9:umount.0 00000020:00000080:3.0:1790391658.325387:0:19144:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e24a3 00000100:00080000:3.0:1790391658.325393:0:19144:0:(import.c:65:import_set_state_nolock()) ffff9e5182091800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790391658.325416:0:19144:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1790391658.325492:0:19144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3636:x1877361186543488:12345-0@lo:9:umount.0 Request processed in 118us (4642us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391658.325597:0:19144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1790391658.325618:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790391658.325622:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790391658.325660:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e528765e000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1790391658.325674:0:3636:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1790391658.325676:0:3636:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790391658.325680:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186543360:0@lo:9:umount.0 00000100:00080000:3.0:1790391658.325692:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e51838d2800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1790391658.325701:0:3636:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1790391658.325703:0:3636:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790391658.325705:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186543488:0@lo:9:umount.0 00010000:00010000:3.0:1790391658.325733:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391658.326263:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790391658.352476:0:3640:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.128@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1790391658.353312:0:3640:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1790391658.353323:0:3640:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e5181cb8380 x1877361186541440/t0(0) o400->MGC192.168.202.128@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790391672 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391658.353346:0:3640:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e518331f480 x1877361186542720/t0(0) o103->MGC192.168.202.128@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790391674 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391658.353356:0:3640:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e518331fb80 x1877361186543104/t0(0) o103->MGC192.168.202.128@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790391674 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391658.353366:0:3640:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e518331f100 x1877361186543232/t0(0) o103->MGC192.168.202.128@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790391674 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391658.353376:0:3640:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e518331ca80 x1877361186542848/t0(0) o103->MGC192.168.202.128@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790391674 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391658.353384:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3638:1877361186541440:0@lo:400:kworker.0 00000100:00100000:0.0:1790391658.353388:0:3640:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e518331f800 x1877361186542976/t0(0) o103->MGC192.168.202.128@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790391674 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790391658.353457:0:3637:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9e5182260000 already not connected (conn 1, was 1): DISCONN 10000000:01000000:0.0:1790391658.353606:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1790391658.353610:0:3640:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1790391658.353611:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1790391658.353617:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9e5182260000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790391658.353622:0:3640:0:(import.c:545:import_select_connection()) MGC192.168.202.128@tcp: connect to NID 0@lo last attempt 465 00000100:00080000:0.0:1790391658.353631:0:3640:0:(import.c:665:import_select_connection()) MGC192.168.202.128@tcp: import ffff9e5182260000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:0.0:1790391658.354635:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3637:1877361186542848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790391658.354660:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3637:1877361186542976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790391658.354951:0:3640:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e51820ad880 x1877361186543616/t0(0) o250->MGC192.168.202.128@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790391658.354984:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3640:1877361186543104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790391658.354991:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3640:1877361186542720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790391658.355008:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3640:1877361186543232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790391658.355246:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3636:1877361186543616:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:0.0:1790391658.355290:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877361186543616 offset 0 length 520: 4 00000020:00080000:2.0:1790391658.373203:0:20973:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9e52ba40cd40) has no exports 00000020:01000000:0.0:1790391658.415589:0:20973:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e528733b600 - data ffff9e52a5766360/ffff9e52b560fc00 00000020:01000000:0.0:1790391658.415750:0:20973:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e52922af120 - data ffff9e52a545f000/ffff9e52b7098c00 00000001:00000004:0.0:1790391658.438131:0:20973:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:3.0:1790391658.486516:0:20973:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790391658.486526:0:20973:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1790391658.486533:0:20973:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1790391658.489258:0:20973:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1790391658.489264:0:20973:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1790391658.489287:0:20973:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790391658.489289:0:20973:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1790391658.489727:0:17942:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1790391658.489732:0:17942:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:0.0:1790391658.489743:0:17942:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1790391658.490810:0:20973:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1790391658.490816:0:20973:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1790391658.490832:0:20973:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790391658.490834:0:20973:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1790391658.491434:0:17944:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1790391658.491453:0:17944:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1790391658.491464:0:17944:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1790391658.493161:0:20973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e21a8 00000020:00000080:3.0:1790391658.493172:0:20973:0:(genops.c:885:class_export_put()) final put ffff9e52b5cbd000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1790391658.493383:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b5cbd000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1790391658.495393:0:20973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e21bd 00000020:00000080:3.0:1790391658.495406:0:20973:0:(genops.c:885:class_export_put()) final put ffff9e52b5cff000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1790391658.495423:0:20973:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1790391658.495429:0:20973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790391658.495439:0:20973:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790391658.495443:0:20973:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9e52b5ca99c0) has no exports 00000004:01000000:3.0:1790391658.495616:0:20973:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1790391658.495625:0:20973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e2211 00000020:00000080:3.0:1790391658.495629:0:20973:0:(genops.c:885:class_export_put()) final put ffff9e52a75c2800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1790391658.495633:0:20973:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1790391658.495637:0:20973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790391658.495641:0:20973:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1790391658.495644:0:20973:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9e52b9aa8000) has no exports 00000020:00000080:3.0:1790391658.495651:0:20973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e220a 00000020:00000080:3.0:1790391658.495654:0:20973:0:(genops.c:885:class_export_put()) final put ffff9e51838d4000/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1790391658.496053:0:20973:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1790391658.496058:0:20973:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1790391658.496063:0:20973:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1790391658.496079:0:20973:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790391658.496082:0:20973:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790391658.496111:0:20973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790391658.496117:0:20973:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1790391658.496128:0:20973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e21fc 00000020:00000080:3.0:1790391658.496132:0:20973:0:(genops.c:885:class_export_put()) final put ffff9e52b9931800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1790391658.496136:0:20973:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1790391658.496139:0:20973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790391658.496143:0:20973:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1790391658.496145:0:20973:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9e52b9aa99c0) has no exports 00000020:00000080:3.0:1790391658.496149:0:20973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e21ee 00000020:00000080:3.0:1790391658.496152:0:20973:0:(genops.c:885:class_export_put()) final put ffff9e528765a800/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1790391658.496482:0:20973:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1790391658.496485:0:20973:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1790391658.496488:0:20973:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1790391658.496491:0:20973:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790391658.496493:0:20973:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790391658.496514:0:20973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790391658.496519:0:20973:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1790391658.496535:0:20973:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1790391658.496540:0:20973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e21e0 00000020:00000080:3.0:1790391658.496545:0:20973:0:(genops.c:885:class_export_put()) final put ffff9e52b9936000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1790391658.496549:0:20973:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1790391658.496552:0:20973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790391658.496556:0:20973:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1790391658.496558:0:20973:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9e52b5ef99c0) has no exports 00000020:00000080:3.0:1790391658.496562:0:20973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e21d9 00000020:00000080:3.0:1790391658.496564:0:20973:0:(genops.c:885:class_export_put()) final put ffff9e5287658000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1790391658.498103:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b5cff000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:0.0:1790391658.498117:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52a75c2800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1790391658.498123:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e51838d4000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1790391658.498129:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e51838d2800 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1790391658.498135:0:36:0:(genops.c:885:class_export_put()) final put ffff9e52b9937000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790391658.498138:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b9937000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1790391658.498143:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790391658.498227:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b9931800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1790391658.498232:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e528765a800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1790391658.498235:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e528765e000 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1790391658.498239:0:36:0:(genops.c:885:class_export_put()) final put ffff9e52b9932800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790391658.498241:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b9932800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1790391658.498243:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790391658.498268:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b9936000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1790391658.498283:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5287658000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1790391658.498951:0:20973:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1790391658.498957:0:20973:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790391658.498961:0:20973:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790391658.498967:0:20973:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790391658.499029:0:20973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790391658.499039:0:20973:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790391658.499071:0:20973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790391658.499075:0:20973:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790391658.499079:0:20973:0:(genops.c:885:class_export_put()) final put ffff9e52b5cbf000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790391658.499091:0:20973:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b5cbf000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1790391658.499096:0:20973:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790391658.499212:0:20973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e21c4 00000020:00000080:0.0:1790391658.499218:0:20973:0:(genops.c:885:class_export_put()) final put ffff9e52b5cfc800/lustre-MDD0001_UUID 00000020:01000000:0.0:1790391658.499223:0:20973:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1790391658.499227:0:20973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790391658.499231:0:20973:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790391658.499235:0:20973:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9e52ba4099c0) has no exports 00000020:00000080:0.0:1790391658.499255:0:20973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790391658.499259:0:20973:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1790391658.499263:0:20973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e21cb 00000020:00000080:0.0:1790391658.499266:0:20973:0:(genops.c:885:class_export_put()) final put ffff9e52b5cfe000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1790391658.499284:0:20973:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e5288361800 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1790391658.499287:0:20973:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e5288361800 2 00000020:01000004:0.0:1790391658.499290:0:20973:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e5288361800 from lustre-MDT0001 00000020:00000080:0.0:1790391658.499306:0:20973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790391658.499310:0:20973:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1790391658.499312:0:20973:0:(genops.c:885:class_export_put()) final put ffff9e52b5cbf800/lustre-MDT0001_UUID 00000020:00000080:0.0:1790391658.499314:0:20973:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b5cbf800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1790391658.499320:0:20973:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1790391658.499347:0:20973:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1790391658.499350:0:20973:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1790391658.499353:0:20973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790391658.499356:0:20973:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790391658.499362:0:20973:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9e5284938000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790391658.499368:0:20973:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9e52b5efcd40) has exports, disconnecting them 00000020:00080000:0.0:1790391658.499372:0:20973:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9e5284938000), last request at 1790391567 00000020:00000080:0.0:1790391658.499375:0:20973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e2249 00000020:00080000:0.0:1790391658.499387:0:20973:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e5284938000): rc 0 00000020:00000080:0.0:1790391658.499390:0:20973:0:(genops.c:885:class_export_put()) final put ffff9e5284938000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1790391658.500457:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e528765d000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1790391658.500468:0:36:0:(genops.c:885:class_export_put()) final put ffff9e528765c000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1790391658.500470:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e528765c000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1790391658.500474:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1790391658.500589:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b5cfc800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1790391658.500594:0:36:0:(genops.c:885:class_export_put()) final put ffff9e52b5cbd800/lustre-MDD0001_UUID 00000020:00000080:1.0:1790391658.500596:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b5cbd800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1790391658.500599:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1790391658.501059:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b5cfe000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1790391658.501066:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5284938000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1790391658.524246:0:20973:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1790391658.524264:0:20973:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790391658.524268:0:20973:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790391658.524286:0:20973:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790391658.524453:0:20973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790391658.524462:0:20973:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1790391658.524468:0:20973:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e5288361800 1 00000020:00000080:0.0:1790391658.524475:0:20973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e2170 00000020:00000080:0.0:1790391658.524484:0:20973:0:(genops.c:885:class_export_put()) final put ffff9e5183a11800/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1790391658.524488:0:20973:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1790391658.524492:0:20973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790391658.524680:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e529518d000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1790391658.524688:0:8:0:(genops.c:885:class_export_put()) final put ffff9e528493b800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1790391658.524691:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e528493b800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1790391658.524704:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1790391658.524773:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5183a11800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1790391658.524808:0:20973:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790391658.524813:0:20973:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9e52b9aacd40) has no exports 00000020:00000080:1.0:1790391658.622840:0:20973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790391658.622853:0:20973:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1790391658.622859:0:20973:0:(genops.c:885:class_export_put()) final put ffff9e5288364800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1790391658.622863:0:20973:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5288364800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1790391658.622873:0:20973:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1790391658.626573:0:20973:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e5288363800 00000020:01000000:2.0:1790391658.626603:0:20973:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1790391658.626609:0:20973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790391658.626615:0:20973:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790391658.626619:0:20973:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9e52b5ca8000) has no exports 00000100:00100000:2.0:1790391658.626734:0:17201:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9e5183840800:17201] 0 exiting: rc = 1 00000100:00100000:2.0:1790391658.626848:0:17202:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9e5183285e00:17202] 1 exiting: rc = 0 00000100:00100000:3.0:1790391658.627094:0:20339:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9e528732a600:20339] 3 exiting: rc = 0 00000100:00100000:2.0:1790391658.627383:0:17203:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9e5183284a00:17203] 2 exiting: rc = 0 00000100:00100000:2.0:1790391658.627444:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627451:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627456:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627473:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627479:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627485:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627500:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627506:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627511:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627517:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627522:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627527:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627532:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627538:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627603:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627610:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627615:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627620:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627626:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627630:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627635:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627640:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627645:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627650:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627655:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627660:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627664:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627670:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627677:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627682:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627700:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627706:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627712:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627717:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627722:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627727:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627732:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627738:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627751:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627758:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627763:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627770:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627775:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627780:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627785:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627791:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627796:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627801:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627806:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627811:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627816:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627821:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627827:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627832:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627838:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627843:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627850:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627855:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627863:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627868:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.627874:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.628373:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.628381:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.628387:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391658.635087:0:17204:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9e52849e8c00:17204] 0 exiting: rc = 1 00000100:00100000:0.0:1790391658.635661:0:17205:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9e52849e9600:17205] 1 exiting: rc = 0 00000100:00100000:2.0:1790391658.637671:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.637681:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.637688:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.637692:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.637696:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.637700:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.637704:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.637709:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.637713:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.637734:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.637739:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.637744:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.637749:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.637754:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.637760:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.637766:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.637772:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.637776:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.637782:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.637786:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.637791:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.637796:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.637801:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.637807:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.637812:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.637817:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.637822:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.637827:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.637832:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.637837:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.637842:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.637847:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.637852:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.637857:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.637862:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.637866:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.637872:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.638142:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.638149:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.638154:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.638159:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.638164:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.638169:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.638174:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.638188:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.638193:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.638198:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.638215:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.638221:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.638226:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.638232:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.638236:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.638241:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.638246:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.638251:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.638256:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.638260:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.638267:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.638386:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.638393:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.638398:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.638403:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.638408:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.638413:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.639101:0:17206:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9e5181cb3a00:17206] 0 exiting: rc = 1 00000100:00100000:1.0:1790391658.639623:0:17207:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9e5181cb2000:17207] 1 exiting: rc = 0 00000100:00100000:1.0:1790391658.639697:0:18189:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9e52a0960400:18189] 2 exiting: rc = 0 00000100:00100000:2.0:1790391658.639795:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.639802:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.639808:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.639815:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.639821:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.639827:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.639833:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.639840:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.639846:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.639852:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.639858:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.639864:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.639871:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.641726:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.641766:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.641799:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.641806:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.641812:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.641818:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.641824:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.641829:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.641834:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.641839:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.641845:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.641851:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.641857:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.641863:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.642125:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.642133:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.642140:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.642147:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.642153:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.642160:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.642166:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.642172:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.642178:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.642184:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.642189:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.642194:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.642341:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.642349:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.642354:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.642359:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.642364:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.642369:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.642374:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.642380:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.642386:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.642392:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.642406:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.642412:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.642430:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.642437:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.642444:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.642450:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.642456:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.642463:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.642724:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.642732:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.642738:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.642744:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.642751:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.643105:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391658.643123:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.659163:0:17209:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9e5181cb2200:17209] 1 exiting: rc = 0 00000100:00100000:3.0:1790391658.660700:0:17208:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9e5181cb3400:17208] 0 exiting: rc = 1 00000100:00100000:0.0:1790391658.660821:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.660829:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.660834:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.660839:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.660844:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.660849:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.660854:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.660859:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.660865:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.660870:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.660894:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.660900:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.660905:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.660910:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.660923:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.660929:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.660934:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.660939:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.660944:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.660950:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.660955:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.660979:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.660984:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.660989:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.660993:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.660998:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.661003:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.661007:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.661013:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.661017:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.661021:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.661027:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.661032:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.661037:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.661044:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.661050:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.661055:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.661060:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.661065:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.661069:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.661074:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.661078:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.661083:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.661088:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.661094:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.661099:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.661104:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.661109:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.661114:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.661120:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.661124:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.661129:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.661134:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.661139:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.661143:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.661148:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.661160:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.661165:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.661169:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.661175:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.661180:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.661185:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.661189:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.661195:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391658.661745:0:17211:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9e52afefa400:17211] 1 exiting: rc = 0 00000100:00100000:1.0:1790391658.662030:0:17210:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9e5181cb3600:17210] 0 exiting: rc = 1 00000100:00100000:0.0:1790391658.662113:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662119:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662125:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662130:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662136:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662141:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662146:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662151:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662155:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662159:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662164:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662168:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662173:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662177:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662182:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662188:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662193:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662197:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662263:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662273:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662278:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662284:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662290:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662296:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662300:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662305:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662310:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662325:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662329:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662334:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662339:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662344:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662350:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662354:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662360:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662365:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662370:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662375:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662380:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662385:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662390:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662396:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662401:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662406:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662411:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662416:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662421:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662426:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662431:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662435:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662440:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662445:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662450:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662455:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662460:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662465:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662470:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662476:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662480:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662485:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662491:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662720:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662733:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.662738:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663409:0:17213:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9e52afefb200:17213] 1 exiting: rc = 0 00000100:00100000:0.0:1790391658.663537:0:17212:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9e52afefa800:17212] 0 exiting: rc = 1 00000100:00100000:1.0:1790391658.663620:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663635:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663640:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663644:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663649:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663654:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663658:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663663:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663668:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663673:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663679:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663684:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663689:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663694:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663699:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663704:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663709:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663714:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663718:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663723:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663727:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663732:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663737:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663742:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663747:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663752:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663765:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663771:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663776:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663782:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663786:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663791:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663797:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663801:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663806:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663810:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663822:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663826:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663831:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663836:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663841:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663846:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663850:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663855:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663860:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663865:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663869:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663895:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663901:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663905:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663910:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663923:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663928:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663933:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663940:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663945:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663951:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663956:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663960:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663965:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663970:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663976:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663980:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.663985:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391658.664465:0:17214:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9e5284ecb600:17214] 0 exiting: rc = 1 00000100:00100000:0.0:1790391658.664620:0:17215:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9e5183289e00:17215] 1 exiting: rc = 0 00000100:00100000:2.0:1790391658.665165:0:17216:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9e5183289000:17216] 2 exiting: rc = 0 00000100:00100000:1.0:1790391658.665371:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665377:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665383:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665389:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665394:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665399:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665404:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665421:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665427:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665432:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665438:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665444:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665450:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665455:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665463:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665468:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665486:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665604:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665613:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665618:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665624:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665630:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665635:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665641:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665646:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665651:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665656:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665661:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665666:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665671:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665676:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665682:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665687:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665693:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665699:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665704:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665708:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665713:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665719:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665724:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665743:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665748:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665826:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665833:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665838:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665844:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665850:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665857:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665863:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.665869:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.666187:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.666195:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.666201:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.666219:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.666225:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.666230:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.666235:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.666242:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.666247:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.666253:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.666258:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.666263:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.666269:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391658.666274:0:20973:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1790391658.676216:0:20973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790391658.676230:0:20973:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1790391658.676234:0:20973:0:(genops.c:885:class_export_put()) final put ffff9e5182262000/MDS_uuid 00000020:00000080:1.0:1790391658.676239:0:20973:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5182262000/MDS_uuid for MDS 00000020:01000000:1.0:1790391658.676245:0:20973:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1790391658.676470:0:20973:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1790391659.022917:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391660.045941:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391661.064072:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391662.088352:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790391662.099051:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) f157595d-6a80-4a0f-be35-35ee7e9fe29d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790391662.099074:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) f157595d-6a80-4a0f-be35-35ee7e9fe29d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790391662.099078:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790391662.099089:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1790391662.099096:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e5182dd9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790391662.099106:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 570 00000100:00080000:3.0:1790391662.099113:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1790391662.099122:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e5182dd9800 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:3.0:1790391662.099235:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e52bb399f80 x1877361186543744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790391662.099289:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790391662.099293:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1790391662.099295:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e52b5cb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790391662.099299:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 570 00000100:00080000:3.0:1790391662.099301:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1790391662.099305:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e52b5cb9800 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:3.0:1790391662.099316:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e52bb39b100 x1877361186544000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790391662.099439:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb399f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1877361186543744:0@lo:38:kworker.0 00000400:00000100:3.0:1790391662.099494:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877361186543744 offset 0 length 520: 4 00000100:00100000:3.0:1790391662.099526:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb39b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1877361186544000:0@lo:38:kworker.0 00000400:00000100:3.0:1790391662.099560:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877361186544000 offset 0 length 520: 4 00000100:00100000:3.0:1790391662.099591:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb398380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1877361186544128:0@lo:400:kworker.0 00000400:00000100:3.0:1790391662.099608:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877361186544128 offset 0 length 224: 4 00000100:00100000:3.0:1790391662.099621:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790391662.099626:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb399880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1877361186543872:0@lo:400:kworker.0 00000400:00000100:3.0:1790391662.099641:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877361186543872 offset 0 length 224: 4 00000020:01000004:1.0:1790391662.823763:0:21188:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1790391662.833139:0:21188:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1790391662.833186:0:21188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b763cc00/0x2b1b7949f13e22e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e22ea expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391662.833197:0:21188:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b763cc00/0x2b1b7949f13e22e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e22ea expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391662.833214:0:21188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b763cc00/0x2b1b7949f13e22e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e22ea expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391662.833219:0:21188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.128@tcp lock: ffff9e52b763cc00/0x2b1b7949f13e22e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e22ea expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391662.833236:0:21188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790391662.833241:0:21188:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:3.0:1790391662.833259:0:17190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391662.833266:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e52b763cc00/0x2b1b7949f13e22e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e22ea expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1790391662.833266:0:21188:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:3.0:1790391662.833272:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763cc00 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:3.0:1790391662.833276:0:17190:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e52b763cc00/0x2b1b7949f13e22e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e22ea expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391662.833277:0:21188:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e52bb399f80 x1877361186543744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790391682 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1790391662.833285:0:17190:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e52b763cc00/0x2b1b7949f13e22e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x2b1b7949f13e22ea expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790391662.833292:0:17190:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e52b763cc00/0x2b1b7949f13e22e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x2b1b7949f13e22ea expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391662.833298:0:17190:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790391662.833300:0:17190:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1790391662.833303:0:17190:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1790391662.833318:0:17190:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e5182260000 00010000:00010000:3.0:1790391662.833321:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e52b763cc00/0x2b1b7949f13e22e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x2b1b7949f13e22ea expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391662.833329:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e52b763cc00/0x2b1b7949f13e22e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x2b1b7949f13e22ea expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391662.833332:0:21188:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1790391662.833338:0:21188:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1790391662.833343:0:21188:0:(import.c:65:import_set_state_nolock()) ffff9e5182dd9800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:3.0:1790391662.833346:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391662.833347:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790391662.833348:0:21188:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:3.0:1790391662.833349:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391662.833362:0:21188:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e52bb399f80 x1877361186543744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790391682 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391662.833450:0:21188:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1790391662.833473:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb399f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1877361186543744:0@lo:38:kworker.0 00000100:00100000:1.0:1790391662.833543:0:21188:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1790391662.834313:0:21188:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1790391662.834322:0:21188:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e52bb399880 x1877361186543872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391678 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391662.834436:0:21188:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1790391662.834440:0:21188:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1790391662.834507:0:21188:0:(import.c:65:import_set_state_nolock()) ffff9e52878fd800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1790391662.834549:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1877361186544256:0@lo:39:umount.0 00000100:00100000:0.0:1790391662.834551:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb399880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1877361186543872:0@lo:400:kworker.0 00000400:00000100:3.0:1790391662.834593:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877361186544256 offset 0 length 224: 4 00010000:00010000:3.0:1790391663.112314:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790391663.112500:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) f157595d-6a80-4a0f-be35-35ee7e9fe29d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790391663.112522:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) f157595d-6a80-4a0f-be35-35ee7e9fe29d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790391663.112525:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790391663.112528:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790391663.112608:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790391663.112632:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1877361186544384:0@lo:400:kworker.0 00000400:00000100:2.0:1790391663.112687:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877361186544384 offset 0 length 224: 4 00000001:00100000:0.0:1790391663.634563:0:18703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790391663.634579:0:18703:0:(genops.c:885:class_export_put()) final put ffff9e5182dd9000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1790391663.639620:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5182dd9000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1790391663.639700:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5182dde800 for lustre-OST0000 00000001:00100000:0.0:1790391663.639724:0:19520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790391663.639735:0:19520:0:(genops.c:885:class_export_put()) final put ffff9e5182090000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1790391663.639857:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5182090000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1790391663.639944:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5182091800 for lustre-OST0001 00010000:00010000:3.0:1790391664.137674:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391665.160298:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391666.184704:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790391667.144153:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) f157595d-6a80-4a0f-be35-35ee7e9fe29d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790391667.144171:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) f157595d-6a80-4a0f-be35-35ee7e9fe29d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790391667.144174:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790391667.144178:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790391667.144372:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790391667.144402:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1877361186544512:0@lo:400:kworker.0 00000400:00000100:3.0:1790391667.144495:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877361186544512 offset 0 length 224: 4 00010000:00010000:3.0:1790391667.211190:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391668.232616:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391669.000244:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790391658/real 1790391658] req@ffff9e51820ad880 x1877361186543616/t0(0) o250->MGC192.168.202.128@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790391668 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391669.000291:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e51820ad880 x1877361186543616/t0(0) o250->MGC192.168.202.128@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790391668 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790391669.000318:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e5182260000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790391669.001183:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1790391669.001193:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3636:1877361186543616:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:2.0:1790391669.002700:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) f157595d-6a80-4a0f-be35-35ee7e9fe29d->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790391669.002713:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1790391669.002717:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e5182260000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790391669.002727:0:8:0:(import.c:545:import_select_connection()) MGC192.168.202.128@tcp: connect to NID 0@lo last attempt 571 00000100:00080000:2.0:1790391669.002736:0:8:0:(import.c:630:import_select_connection()) MGC192.168.202.128@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790391669.002746:0:8:0:(import.c:665:import_select_connection()) MGC192.168.202.128@tcp: import ffff9e5182260000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:2.0:1790391669.002798:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e51820ac000 x1877361186544640/t0(0) o250->MGC192.168.202.128@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790391669.007513:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790391669.007538:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790391669.007787:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790391669.007816:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1877361186544768:0@lo:400:kworker.0 00000400:00000100:0.0:1790391669.007933:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877361186544768 offset 0 length 224: 4 00000100:00100000:3.0:1790391669.008350:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3636:1877361186544640:0@lo:250:kworker.0 00000400:00000100:3.0:1790391669.008388:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877361186544640 offset 0 length 520: 4 00010000:00010000:3.0:1790391669.256873:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391670.280205:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391671.305328:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391672.072093:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790391662/real 1790391662] req@ffff9e518331d180 x1877361186544256/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790391672 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391672.072127:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e518331d180 x1877361186544256/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790391672 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790391672.072147:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e52878fd800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1790391672.072167:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1877361186544256:0@lo:39:umount.0 00000100:00080000:1.0:1790391672.072256:0:21188:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1790391672.072266:0:21188:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1790391672.072274:0:21188:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1790391672.073709:0:21188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef800/0x2b1b7949f13e22b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e22c0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391672.073734:0:21188:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef800/0x2b1b7949f13e22b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e22c0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391672.073742:0:21188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef800/0x2b1b7949f13e22b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e22c0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391672.073751:0:21188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef800/0x2b1b7949f13e22b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e22c0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391672.074091:0:21188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790391672.074103:0:21188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5280030400/0x2b1b7949f13e261d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2624 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391672.074109:0:21188:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5280030400/0x2b1b7949f13e261d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e2624 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391672.074113:0:21188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5280030400/0x2b1b7949f13e261d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e2624 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391672.074116:0:21188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.128@tcp lock: ffff9e5280030400/0x2b1b7949f13e261d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e2624 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391672.074868:0:17190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790391672.074921:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef800/0x2b1b7949f13e22b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e22c0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391672.074930:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eef800 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:3.0:1790391672.074935:0:17190:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef800/0x2b1b7949f13e22b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e22c0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391672.074946:0:17190:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef800/0x2b1b7949f13e22b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x2b1b7949f13e22c0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790391672.074954:0:17190:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef800/0x2b1b7949f13e22b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x2b1b7949f13e22c0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391672.074960:0:17190:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790391672.074964:0:17190:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:3.0:1790391672.074980:0:17190:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e5182260000 00010000:00010000:3.0:1790391672.074984:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef800/0x2b1b7949f13e22b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x2b1b7949f13e22c0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391672.074992:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef800/0x2b1b7949f13e22b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x2b1b7949f13e22c0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391672.075031:0:17190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391672.075036:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e5280030400/0x2b1b7949f13e261d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e2624 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391672.075042:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280030400 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:3.0:1790391672.075045:0:17190:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e5280030400/0x2b1b7949f13e261d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e2624 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391672.075052:0:17190:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5280030400/0x2b1b7949f13e261d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2b1b7949f13e2624 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790391672.075060:0:17190:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5280030400/0x2b1b7949f13e261d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2b1b7949f13e2624 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391672.075067:0:17190:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1790391672.075069:0:17190:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1790391672.075074:0:17190:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e5182260000 00010000:00010000:3.0:1790391672.075076:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e5280030400/0x2b1b7949f13e261d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2b1b7949f13e2624 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391672.075083:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391672.075085:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391672.075087:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391672.075187:0:21188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1790391672.075193:0:21188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5280030400/0x2b1b7949f13e261d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2b1b7949f13e2624 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391672.075215:0:21188:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1790391672.075222:0:21188:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:1.0:1790391672.075224:0:21188:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1790391672.075265:0:21188:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1790391672.075271:0:21188:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1790391672.075277:0:21188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790391672.075285:0:21188:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790391672.075291:0:21188:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9e5183384d40) has no exports 00000020:00080000:1.0:1790391672.075323:0:21188:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9e5183384d40) has no exports 00000020:01000000:1.0:1790391672.077324:0:21188:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e52882420c0 - data ffff9e52a55b7438/ffff9e52871e8000 00000020:01000000:1.0:1790391672.077535:0:21188:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e5181def000 - data ffff9e52a54ad510/ffff9e5182dcd800 00010000:00010000:3.0:1790391672.086804:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1790391672.100458:0:21188:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1790391672.134244:0:21188:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e22ce 00000020:00000080:0.0:1790391672.134258:0:21188:0:(genops.c:885:class_export_put()) final put ffff9e5181f6f000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1790391672.134290:0:21188:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e52878bb800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1790391672.134294:0:21188:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e52878bb800 2 00000020:01000004:0.0:1790391672.134298:0:21188:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e52878bb800 from lustre-OST0000 00000020:00000080:0.0:1790391672.134327:0:21188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790391672.134339:0:21188:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1790391672.134342:0:21188:0:(genops.c:885:class_export_put()) final put ffff9e5181f6e000/lustre-OST0000_UUID 00000020:00000080:0.0:1790391672.134345:0:21188:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5181f6e000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1790391672.134352:0:21188:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1790391672.134436:0:21188:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1790391672.134441:0:21188:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1790391672.134445:0:21188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790391672.134450:0:21188:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790391672.134457:0:21188:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9e5182ddd000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790391672.134478:0:21188:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff9e52ba408000) has exports, disconnecting them 00000020:00080000:0.0:1790391672.134483:0:21188:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9e5182ddd000), last request at 1790391584 00000020:00000080:0.0:1790391672.134487:0:21188:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e22f8 00000020:00080000:0.0:1790391672.134496:0:21188:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e5182ddd000): rc 0 00000020:00000080:0.0:1790391672.134501:0:21188:0:(genops.c:885:class_export_put()) final put ffff9e5182ddd000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1790391672.138021:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5181f6f000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1790391672.138056:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5182ddd000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1790391672.138192:0:21188:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1790391672.138199:0:21188:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790391672.138206:0:21188:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1790391672.138213:0:21188:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790391672.138279:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5182dd9800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1790391672.138537:0:21188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790391672.138549:0:21188:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1790391672.138556:0:21188:0:(genops.c:885:class_export_put()) final put ffff9e52b5cba000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1790391672.138560:0:21188:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b5cba000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1790391672.138596:0:21188:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1790391672.138687:0:21188:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1790391672.138693:0:21188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790391672.138699:0:21188:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1790391672.138707:0:21188:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9e52878fa000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790391672.138714:0:21188:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff9e5182df4d40) has exports, disconnecting them 00000020:00080000:3.0:1790391672.138719:0:21188:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9e52878fa000), last request at 1790391584 00000020:00000080:3.0:1790391672.138724:0:21188:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e230d 00000020:00080000:3.0:1790391672.138740:0:21188:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e52878fa000): rc 0 00000020:00000080:3.0:1790391672.138746:0:21188:0:(genops.c:885:class_export_put()) final put ffff9e52878fa000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1790391672.140907:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52878fa000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1790391672.149024:0:21188:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1790391672.149038:0:21188:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1790391672.149043:0:21188:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1790391672.149053:0:21188:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790391672.149096:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e52878fd800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1790391672.149314:0:21188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790391672.149324:0:21188:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1790391672.149330:0:21188:0:(genops.c:885:class_export_put()) final put ffff9e52878fd000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1790391672.149335:0:21188:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52878fd000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1790391672.149342:0:21188:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1790391672.149453:0:21188:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e52878bb800 1 00000020:00000080:1.0:1790391672.149461:0:21188:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e22ab 00000020:00000080:1.0:1790391672.149470:0:21188:0:(genops.c:885:class_export_put()) final put ffff9e51838d5000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1790391672.149481:0:21188:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1790391672.149490:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e51838d5000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1790391672.149499:0:21188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790391672.149503:0:21188:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790391672.149508:0:21188:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff9e52b9d73380) has no exports 00000020:00000080:2.0:1790391672.314333:0:21188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790391672.314659:0:21188:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1790391672.314667:0:21188:0:(genops.c:885:class_export_put()) final put ffff9e52878be000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1790391672.314674:0:21188:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52878be000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1790391672.314693:0:21188:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1790391672.314862:0:21188:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e52878b9000 00000020:02000400:2.0:1790391672.318020:0:21188:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1790391672.331475:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391673.353159:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790391674.376122:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) f157595d-6a80-4a0f-be35-35ee7e9fe29d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790391674.376134:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) f157595d-6a80-4a0f-be35-35ee7e9fe29d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790391674.376138:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790391674.376141:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790391674.376254:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790391674.376276:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1877361186544896:0@lo:400:kworker.0 00000400:00000100:2.0:1790391674.376329:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877361186544896 offset 0 length 224: 4 00010000:00010000:2.0:1790391674.376391:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391675.401508:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391676.425595:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790391676.452572:0:21390:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1790391676.476295:0:21390:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1790391676.476382:0:21390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5183087600/0x2b1b7949f13e2441 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2448 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391676.476399:0:21390:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5183087600/0x2b1b7949f13e2441 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e2448 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391676.476407:0:21390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5183087600/0x2b1b7949f13e2441 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e2448 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391676.476414:0:21390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.128@tcp lock: ffff9e5183087600/0x2b1b7949f13e2441 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e2448 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391676.476468:0:21390:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1790391676.476475:0:21390:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1790391676.476503:0:21390:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790391676.476517:0:21390:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e52bb39b100 x1877361186544000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790391682 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391676.476540:0:21390:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1790391676.476547:0:21390:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1790391676.476554:0:21390:0:(import.c:65:import_set_state_nolock()) ffff9e52b5cb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1790391676.476573:0:21390:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790391676.476577:0:21390:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e52bb39b100 x1877361186544000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790391682 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391676.476583:0:21390:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1790391676.476586:0:21390:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:1.0:1790391676.476650:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb39b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1877361186544000:0@lo:38:kworker.0 00000100:00080000:0.0:1790391676.477679:0:21390:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1790391676.477690:0:21390:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e52bb398380 x1877361186544128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391678 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391676.477778:0:21390:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e518331ea00 x1877361186544384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391679 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391676.477798:0:21390:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e518331ce00 x1877361186544512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391683 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391676.477812:0:21390:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e51820ad500 x1877361186544768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391685 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391676.477820:0:21390:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e51820af800 x1877361186544896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391690 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391676.477831:0:21390:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1790391676.477836:0:21390:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1790391676.478083:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1877361186544512:0@lo:400:kworker.0 00000100:00080000:0.0:1790391676.478219:0:21390:0:(import.c:65:import_set_state_nolock()) ffff9e51823ec800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1790391676.478290:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1877361186545024:0@lo:39:umount.0 00000400:00000100:2.0:1790391676.478340:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877361186545024 offset 0 length 224: 4 00000100:00100000:1.0:1790391676.478453:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb398380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1877361186544128:0@lo:400:kworker.0 00000100:00100000:1.0:1790391676.478468:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1877361186544768:0@lo:400:kworker.0 00010000:00010000:3.0:1790391676.479032:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391676.479042:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e5183087600/0x2b1b7949f13e2441 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e2448 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391676.479051:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183087600 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:3.0:1790391676.479055:0:17191:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e5183087600/0x2b1b7949f13e2441 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e2448 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391676.479077:0:17191:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5183087600/0x2b1b7949f13e2441 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2b1b7949f13e2448 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790391676.479085:0:17191:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5183087600/0x2b1b7949f13e2441 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2b1b7949f13e2448 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391676.479090:0:17191:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790391676.479093:0:17191:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1790391676.479097:0:17191:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1790391676.479112:0:17191:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e5182260000 00010000:00010000:3.0:1790391676.479125:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e5183087600/0x2b1b7949f13e2441 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2b1b7949f13e2448 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391676.479132:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5183087600/0x2b1b7949f13e2441 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2b1b7949f13e2448 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391676.479146:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391676.479148:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391676.479149:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391676.481367:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1877361186544384:0@lo:400:kworker.0 00000100:00100000:1.0:1790391676.481417:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1877361186544896:0@lo:400:kworker.0 00010000:00010000:1.0:1790391677.448530:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391678.472667:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391679.496208:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790391679.498707:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) f157595d-6a80-4a0f-be35-35ee7e9fe29d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790391679.498731:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) f157595d-6a80-4a0f-be35-35ee7e9fe29d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1790391680.520325:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391681.544288:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391682.568593:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391683.592085:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391684.620482:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790391684.621074:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) f157595d-6a80-4a0f-be35-35ee7e9fe29d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790391684.621082:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) f157595d-6a80-4a0f-be35-35ee7e9fe29d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790391684.680031:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790391669/real 1790391669] req@ffff9e51820ac000 x1877361186544640/t0(0) o250->MGC192.168.202.128@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790391684 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391684.680070:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e51820ac000 x1877361186544640/t0(0) o250->MGC192.168.202.128@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790391684 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790391684.680096:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e5182260000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790391684.680269:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1790391684.680274:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3636:1877361186544640:0@lo:250:kworker.0 00000100:00080000:3.0:1790391684.680344:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) f157595d-6a80-4a0f-be35-35ee7e9fe29d->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790391684.680350:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1790391684.680352:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e5182260000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790391684.680357:0:37:0:(import.c:545:import_select_connection()) MGC192.168.202.128@tcp: connect to NID 0@lo last attempt 582 00000100:00080000:3.0:1790391684.680363:0:37:0:(import.c:630:import_select_connection()) MGC192.168.202.128@tcp: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1790391684.680370:0:37:0:(import.c:665:import_select_connection()) MGC192.168.202.128@tcp: import ffff9e5182260000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:3.0:1790391684.680404:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e52bb39b480 x1877361186545152/t0(0) o250->MGC192.168.202.128@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790391684.680477:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb39b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3636:1877361186545152:0@lo:250:kworker.0 00000400:00000100:2.0:1790391684.680526:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877361186545152 offset 0 length 520: 4 00010000:00010000:0.0:1790391685.640608:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391686.664142:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391686.728026:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790391676/real 1790391676] req@ffff9e51838f4000 x1877361186545024/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790391686 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391686.728061:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e51838f4000 x1877361186545024/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790391686 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790391686.728083:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e51823ec800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1790391686.728106:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1877361186545024:0@lo:39:umount.0 00000100:00080000:0.0:1790391686.728213:0:21390:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1790391686.728218:0:21390:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1790391686.728224:0:21390:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1790391686.729150:0:21390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5183087400/0x2b1b7949f13e2417 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e241e expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391686.729185:0:21390:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5183087400/0x2b1b7949f13e2417 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e241e expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391686.729192:0:21390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5183087400/0x2b1b7949f13e2417 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e241e expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391686.729198:0:21390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.128@tcp lock: ffff9e5183087400/0x2b1b7949f13e2417 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e241e expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391686.729227:0:21390:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790391686.729234:0:21390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5280030000/0x2b1b7949f13e260f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2616 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391686.729241:0:21390:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5280030000/0x2b1b7949f13e260f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e2616 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391686.729247:0:21390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5280030000/0x2b1b7949f13e260f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e2616 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391686.729253:0:21390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.128@tcp lock: ffff9e5280030000/0x2b1b7949f13e260f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e2616 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391686.729273:0:21390:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1790391686.729278:0:21390:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00010000:00010000:1.0:1790391686.729281:0:17190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790391686.729291:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e5183087400/0x2b1b7949f13e2417 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e241e expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391686.729301:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183087400 already unused, calling callback (ffffffffc124dc20) 00000020:01000004:0.0:1790391686.729302:0:21390:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 10000000:00010000:1.0:1790391686.729305:0:17190:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e5183087400/0x2b1b7949f13e2417 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e241e expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:0.0:1790391686.729307:0:21390:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1790391686.729314:0:21390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:1.0:1790391686.729318:0:17190:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5183087400/0x2b1b7949f13e2417 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2b1b7949f13e241e expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1790391686.729322:0:21390:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 10000000:00010000:1.0:1790391686.729330:0:17190:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5183087400/0x2b1b7949f13e2417 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2b1b7949f13e241e expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1790391686.729331:0:21390:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9e52ba40b380) has no exports 10000000:01000000:1.0:1790391686.729338:0:17190:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790391686.729342:0:17190:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1790391686.729345:0:17190:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1790391686.729359:0:17190:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e5182260000 00000020:00080000:0.0:1790391686.729360:0:21390:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9e52ba40b380) has no exports 00010000:00010000:1.0:1790391686.729363:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e5183087400/0x2b1b7949f13e2417 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2b1b7949f13e241e expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391686.729371:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5183087400/0x2b1b7949f13e2417 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2b1b7949f13e241e expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391686.729397:0:17190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391686.729400:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e5280030000/0x2b1b7949f13e260f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e2616 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391686.729405:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280030000 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:1.0:1790391686.729408:0:17190:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e5280030000/0x2b1b7949f13e260f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e2616 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391686.729414:0:17190:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5280030000/0x2b1b7949f13e260f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2b1b7949f13e2616 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391686.729420:0:17190:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5280030000/0x2b1b7949f13e260f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2b1b7949f13e2616 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391686.729425:0:17190:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1790391686.729428:0:17190:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1790391686.729429:0:17190:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1790391686.729434:0:17190:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e5182260000 00010000:00010000:1.0:1790391686.729436:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e5280030000/0x2b1b7949f13e260f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2b1b7949f13e2616 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391686.729443:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5280030000/0x2b1b7949f13e260f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2b1b7949f13e2616 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391686.729466:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391686.729469:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391686.729470:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1790391686.730863:0:21390:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e5288242de0 - data ffff9e52a549a948/ffff9e52871e8800 00000020:01000000:0.0:1790391686.731052:0:21390:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e528550f660 - data ffff9e52a5748e58/ffff9e52b560d800 00010000:00010000:3.0:1790391686.731391:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1790391686.740573:0:21390:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1790391686.752409:0:21390:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e242c 00000020:00000080:1.0:1790391686.752422:0:21390:0:(genops.c:885:class_export_put()) final put ffff9e52b9930000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1790391686.752463:0:21390:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e52b5fb1000 from lustre-OST0001, refs=2 00000020:01000004:1.0:1790391686.752467:0:21390:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e52b5fb1000 2 00000020:01000004:1.0:1790391686.752470:0:21390:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e52b5fb1000 from lustre-OST0001 00000020:00000080:1.0:1790391686.752501:0:21390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790391686.752511:0:21390:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1790391686.752514:0:21390:0:(genops.c:885:class_export_put()) final put ffff9e5182dda800/lustre-OST0001_UUID 00000020:00000080:1.0:1790391686.752517:0:21390:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5182dda800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1790391686.752523:0:21390:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1790391686.752625:0:21390:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import f157595d-6a80-4a0f-be35-35ee7e9fe29d->MGS 00010000:00010000:1.0:1790391686.752640:0:21390:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e52b5eefc00/0x2b1b7949f13e2177 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2b1b7949f13e217e expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391686.752663:0:21390:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e52b5eefc00/0x2b1b7949f13e2177 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2b1b7949f13e217e expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391686.752670:0:21390:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1790391686.752672:0:21390:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1790391686.752675:0:21390:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1790391686.752689:0:21390:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e5182260000 00010000:00010000:1.0:1790391686.752692:0:21390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e52b5eefc00/0x2b1b7949f13e2177 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2b1b7949f13e217e expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391686.752708:0:21390:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5183086400/0x2b1b7949f13e2066 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2b1b7949f13e206d expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391686.752715:0:21390:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5183086400/0x2b1b7949f13e2066 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2b1b7949f13e206d expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391686.752719:0:21390:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790391686.752721:0:21390:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1790391686.752723:0:21390:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1790391686.752737:0:21390:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e5182260000 00010000:00010000:1.0:1790391686.752740:0:21390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5183086400/0x2b1b7949f13e2066 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2b1b7949f13e206d expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1790391686.752756:0:21390:0:(import.c:65:import_set_state_nolock()) ffff9e5182260000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1790391686.752760:0:21390:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1790391686.752762:0:21390:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1790391686.752763:0:21390:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1790391686.752767:0:21390:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1790391686.752778:0:21390:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e52bb39b480 x1877361186545152/t0(0) o250->MGC192.168.202.128@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1790391704 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1790391686.752799:0:21390:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1790391686.752802:0:21390:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000100:00100000:2.0:1790391686.752945:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb39b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3636:1877361186545152:0@lo:250:kworker.0 00000020:00000080:3.0:1790391686.753044:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b9930000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:1.0:1790391686.755934:0:21390:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1790391686.755953:0:21390:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e2051 00000020:00000080:1.0:1790391686.755962:0:21390:0:(genops.c:885:class_export_put()) final put ffff9e5182266800/f157595d-6a80-4a0f-be35-35ee7e9fe29d 00000020:01000000:1.0:1790391686.755981:0:21390:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.128@tcp (flags='') 00000020:00000080:1.0:1790391686.755987:0:21390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790391686.755996:0:21390:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.128@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1790391686.756000:0:21390:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9e52b5cacd40) has no exports 00000020:00000080:3.0:1790391686.756158:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5182266800/f157595d-6a80-4a0f-be35-35ee7e9fe29d for MGC192.168.202.128@tcp 10000000:01000000:2.0:1790391686.758666:0:17199:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1790391686.758870:0:21390:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.128@tcp: client import never connected 00000100:00080000:1.0:1790391686.758898:0:21390:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1790391686.758903:0:21390:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1790391686.758907:0:21390:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1790391686.758910:0:21390:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1790391686.758964:0:21390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790391686.758973:0:21390:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.128@tcp (uuid f157595d-6a80-4a0f-be35-35ee7e9fe29d) 00000020:01000000:1.0:1790391686.758981:0:21390:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1790391686.758989:0:21390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790391686.758994:0:21390:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1790391686.759000:0:21390:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9e5182091000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790391686.759006:0:21390:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff9e5290bf4d40) has exports, disconnecting them 00000020:00080000:1.0:1790391686.759025:0:21390:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9e5182091000), last request at 1790391600 00000020:00000080:1.0:1790391686.759031:0:21390:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e2456 00000020:00080000:1.0:1790391686.759044:0:21390:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e5182091000): rc 0 00000020:00000080:3.0:1790391686.760789:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5182260000 for MGC192.168.202.128@tcp 00000020:00000080:3.0:1790391686.760820:0:37:0:(genops.c:885:class_export_put()) final put ffff9e5182260800/f157595d-6a80-4a0f-be35-35ee7e9fe29d 00000020:00000080:3.0:1790391686.760824:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5182260800/f157595d-6a80-4a0f-be35-35ee7e9fe29d for MGC192.168.202.128@tcp 00000020:01000000:3.0:1790391686.760833:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.128@tcp (f157595d-6a80-4a0f-be35-35ee7e9fe29d) 00000020:00000080:1.0:1790391686.761563:0:21390:0:(genops.c:885:class_export_put()) final put ffff9e5182091000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1790391686.764421:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5182091000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1790391686.772996:0:21390:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1790391686.773006:0:21390:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790391686.773010:0:21390:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1790391686.773018:0:21390:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790391686.773210:0:21390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790391686.773219:0:21390:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1790391686.773226:0:21390:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1790391686.773232:0:21390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790391686.773236:0:21390:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790391686.773244:0:21390:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9e51823ea000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790391686.773250:0:21390:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff9e5182df0000) has exports, disconnecting them 00000020:00080000:2.0:1790391686.773254:0:21390:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9e51823ea000), last request at 1790391600 00000020:00000080:2.0:1790391686.773258:0:21390:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e246b 00000020:00080000:2.0:1790391686.773283:0:21390:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e51823ea000): rc 0 00000020:00000080:2.0:1790391686.773288:0:21390:0:(genops.c:885:class_export_put()) final put ffff9e51823ea000/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1790391686.774308:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e52b5cb9800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1790391686.774319:0:37:0:(genops.c:885:class_export_put()) final put ffff9e5182092800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1790391686.774322:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5182092800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1790391686.774330:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1790391686.774388:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e51823ea000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1790391686.774414:0:21390:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1790391686.774418:0:21390:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1790391686.774421:0:21390:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1790391686.774425:0:21390:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790391686.774446:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e51823ec800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1790391686.774507:0:17190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1790391686.774607:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:3.0:1790391686.774721:0:17186:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9e52b5e6f600:17186] 1 exiting: rc = 0 00000100:00100000:3.0:1790391686.774800:0:17185:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9e52b5e6e800:17185] 0 exiting: rc = 1 00000100:00100000:3.0:1790391686.774857:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.775113:0:17188:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9e52b5e6ea00:17188] 1 exiting: rc = 0 00000100:00100000:3.0:1790391686.775456:0:17187:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9e52b5e6e600:17187] 0 exiting: rc = 1 00000100:00100000:3.0:1790391686.775525:0:20226:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9e5182311e00:20226] 3 exiting: rc = 0 00000100:00100000:3.0:1790391686.775596:0:17189:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9e52b5e6fc00:17189] 2 exiting: rc = 0 00000100:00100000:3.0:1790391686.775635:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.775642:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.775648:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.775665:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.775672:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.775689:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.775705:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.775711:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.775716:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.775721:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.775726:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.775731:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.775736:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.775742:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.775747:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.775751:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.775756:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.775761:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.775765:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.775770:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.775774:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.775779:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.775783:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.775789:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.775794:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.775799:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.775804:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.775808:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.775813:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.775818:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.775823:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.775828:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.775832:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.775837:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.775841:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.775855:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.775860:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.775865:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.775871:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.775896:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.775907:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.775919:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.775925:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.776091:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.776100:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.776105:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.776110:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.776116:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.776120:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.776125:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.776130:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.776144:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.776149:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.776154:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.776160:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.776164:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.776169:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.776174:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.776179:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.776184:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.776188:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.776194:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.776199:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.776204:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1790391686.777036:0:21390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790391686.777045:0:21390:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1790391686.777051:0:21390:0:(genops.c:885:class_export_put()) final put ffff9e51823e8000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1790391686.777055:0:21390:0:(genops.c:844:class_export_destroy()) destroying export ffff9e51823e8000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1790391686.777060:0:21390:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1790391686.777104:0:21390:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e52b5fb1000 1 00000020:00000080:3.0:1790391686.777109:0:21390:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e2410 00000020:00000080:3.0:1790391686.777114:0:21390:0:(genops.c:885:class_export_put()) final put ffff9e5182dde000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1790391686.777125:0:21390:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1790391686.777190:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5182dde000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1790391686.777211:0:21390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790391686.777216:0:21390:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1790391686.777220:0:21390:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff9e5182df19c0) has no exports 00000020:00000080:3.0:1790391686.815621:0:21390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790391686.815641:0:21390:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1790391686.815648:0:21390:0:(genops.c:885:class_export_put()) final put ffff9e52b5fb3000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1790391686.815663:0:21390:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b5fb3000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1790391686.815681:0:21390:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1790391686.816225:0:21390:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e52b5fb6800 00000020:01000000:3.0:1790391686.816254:0:21390:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1790391686.816260:0:21390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790391686.816265:0:21390:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1790391686.816270:0:21390:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9e5183383380) has no exports 00000020:00000080:3.0:1790391686.816298:0:21390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790391686.816305:0:21390:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1790391686.816309:0:21390:0:(genops.c:885:class_export_put()) final put ffff9e51838d3800/OSS_uuid 00000020:00000080:3.0:1790391686.816311:0:21390:0:(genops.c:844:class_export_destroy()) destroying export ffff9e51838d3800/OSS_uuid for OSS 00000020:01000000:3.0:1790391686.816319:0:21390:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1790391686.816498:0:19144:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9e518201ba00:19144] 3 exiting: rc = 0 00000100:00100000:3.0:1790391686.816612:0:18709:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9e5182cd3c00:18709] 2 exiting: rc = 0 00000100:00100000:3.0:1790391686.816677:0:18708:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9e5182cd3800:18708] 1 exiting: rc = 0 00000100:00100000:3.0:1790391686.816747:0:18707:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9e518331a000:18707] 0 exiting: rc = 1 00000100:00100000:3.0:1790391686.816912:0:20517:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff9e518335a400:20517] 4 exiting: rc = 0 00000100:00100000:3.0:1790391686.817055:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817067:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817073:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817079:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817085:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817091:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817098:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817104:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817109:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817131:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817138:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817143:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817149:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817154:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817161:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817167:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817174:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817179:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817185:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817191:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817196:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817201:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817209:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817214:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817219:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817227:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817233:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817245:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817254:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817261:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817271:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00080000:1.0:1790391686.817274:0:17198:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1790391686.817285:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817301:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817312:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817326:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817338:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817351:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817359:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817436:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817446:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817453:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817465:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817476:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817485:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817502:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817508:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817515:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817521:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817527:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817534:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817540:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817547:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817552:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817559:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817568:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817574:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817579:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817586:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817597:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817607:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817623:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817630:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817636:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.817643:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391686.819254:0:18711:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9e5287396e00:18711] 1 exiting: rc = 0 00000100:00100000:2.0:1790391686.820287:0:18710:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9e5287397000:18710] 0 exiting: rc = 1 00000100:00100000:3.0:1790391686.820350:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820359:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820364:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820370:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820375:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820381:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820387:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820392:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820397:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820402:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820407:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820412:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820418:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820423:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820428:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820445:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820450:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820455:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820460:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820465:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820470:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820475:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820481:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820646:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820665:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820672:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820677:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820682:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820687:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820692:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820697:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820702:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820732:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820738:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820743:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820748:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820752:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820757:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820762:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820767:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820771:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820777:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820782:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820787:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820791:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820796:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820802:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820807:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820812:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820817:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820828:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820834:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820838:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820843:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820848:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820852:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820857:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820861:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820866:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.820870:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.821069:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.821078:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.821083:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.821088:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391686.823713:0:18713:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9e52878c8000:18713] 1 exiting: rc = 0 00000100:00100000:2.0:1790391686.823974:0:18712:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9e52878c9800:18712] 0 exiting: rc = 1 00000100:00100000:3.0:1790391686.824094:0:18714:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9e52878c8600:18714] 2 exiting: rc = 0 00000100:00100000:0.0:1790391686.824371:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824379:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824385:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824389:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824394:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824400:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824405:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824410:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824416:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824431:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824438:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824443:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824449:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824454:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824460:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824464:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824470:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824476:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824481:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824594:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824603:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824609:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824615:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824620:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824626:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824632:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824638:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824644:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824649:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824670:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824687:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824693:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824699:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824713:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824718:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824721:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824725:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824728:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824732:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824736:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824739:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824742:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824746:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824749:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824752:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824757:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824761:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824765:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824768:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824773:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824777:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824780:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824783:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824787:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824790:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824793:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824796:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824804:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824809:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824813:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824816:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824819:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824823:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391686.824826:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.830483:0:18715:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9e52878c8a00:18715] 0 exiting: rc = 1 00000100:00100000:0.0:1790391686.830727:0:18716:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9e52878c8c00:18716] 1 exiting: rc = 0 00000100:00100000:2.0:1790391686.830847:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.830855:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.830861:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.830866:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.830872:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831125:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831220:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831229:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831234:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831239:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831245:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831250:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831255:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831260:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831264:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831269:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831274:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831280:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831285:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831291:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831296:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831301:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831306:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831311:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831316:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831322:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831327:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831332:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831337:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831342:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831358:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831363:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831369:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831374:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831380:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831385:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831390:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831394:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831400:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831404:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831408:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831414:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831418:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831423:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831428:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831433:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831437:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831442:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831448:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831454:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831460:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831465:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831470:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831475:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831480:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831611:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831621:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831626:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831631:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831637:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831642:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831646:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831661:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391686.831668:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.833643:0:18717:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9e5287252c00:18717] 0 exiting: rc = 1 00000100:00100000:2.0:1790391686.833837:0:18718:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9e51833b5400:18718] 1 exiting: rc = 0 00000100:00100000:3.0:1790391686.834263:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834282:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834309:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834316:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834322:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834328:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834333:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834339:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834344:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834352:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834358:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834364:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834371:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834377:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834397:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834404:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834410:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834424:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834431:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834436:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834441:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834447:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834453:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834459:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834465:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834470:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834608:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834618:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834628:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834635:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834641:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834647:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834662:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834669:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834674:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834680:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834685:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834691:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834712:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834718:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834724:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834730:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834736:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834741:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834746:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834752:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834757:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834762:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834767:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834772:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834790:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834796:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834809:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834816:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834822:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834828:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834834:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834840:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834846:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834852:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834857:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834864:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.834869:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391686.835430:0:21390:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1790391686.847734:0:21390:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1790391708.114979:0:22155:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg228-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1790391721.674007:0:22755:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790391721.674013:0:22755:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1790391721.674014:0:22755:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1790391721.674093:0:22755:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e52b56dd000 00000020:01000004:2.0:1790391721.674105:0:22755:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1790391721.674112:0:22755:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1790391721.674125:0:22755:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9e5290bf0000) 00000020:00000080:2.0:1790391721.674136:0:22755:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1790391721.732998:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1790391721.734464:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1790391721.748580:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1790391721.749325:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1790391721.749834:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1790391721.750162:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1790391721.750479:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1790391721.750926:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1790391721.751322:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1790391721.751565:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1790391721.752148:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1790391721.752650:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1790391721.753116:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1790391721.753415:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1790391721.759143:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1790391721.759942:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1790391721.760381:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1790391721.760754:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1790391721.761041:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1790391721.761322:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1790391721.761526:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1790391721.761822:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1790391721.762458:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1790391721.763198:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1790391721.763523:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1790391721.763797:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1790391721.764114:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1790391721.764456:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1790391721.764773:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1790391721.765003:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1790391721.765196:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1790391721.765514:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1790391721.765849:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1790391721.766282:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1790391721.766508:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1790391721.766989:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1790391721.767708:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1790391721.768008:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1790391721.768310:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1790391721.768571:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1790391721.769279:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1790391721.769569:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1790391721.770010:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1790391721.770279:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1790391721.770525:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1790391721.770971:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1790391721.771171:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1790391721.771783:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1790391721.772827:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1790391721.773153:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1790391721.774045:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1790391721.774438:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1790391721.774646:0:22755:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:1.0:1790391721.775717:0:22755:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1790391721.776411:0:22755:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1790391721.776423:0:22755:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790391721.776436:0:22755:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2b1b7949f13e28c4 00000020:01000004:2.0:1790391721.776444:0:22755:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1790391721.776448:0:22755:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1790391721.776453:0:22755:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e52b56dd000 from MGS 00000020:01000004:2.0:1790391721.776456:0:22755:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1790391721.776468:0:22755:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9e5290bf19c0) 00000020:00000080:2.0:1790391721.776479:0:22755:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1790391721.776532:0:22755:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e52b56dd000 from MGS, refs=2 00080000:01000000:2.0:1790391721.776536:0:22755:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790391721.776541:0:22755:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2b1b7949f13e28d2 00000100:00100000:2.0:1790391721.776749:0:22755:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1790391721.776915:0:22755:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1790391721.776921:0:22755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1790391721.777609:0:22755:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1790391721.777632:0:22755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1790391721.778704:0:22755:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790391721.779127:0:22755:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1790391721.779135:0:22755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1790391721.784672:0:22755:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1790391721.784688:0:22755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1790391721.785178:0:22755:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1790391721.785185:0:22755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1790391721.785910:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391721.785914:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391721.785916:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391721.786288:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391721.786290:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391721.786292:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391721.787035:0:22755:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1790391721.788830:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1790391721.811227:0:22755:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1790391721.812753:0:22767:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1790391721.812835:0:22755:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1790391721.812954:0:22755:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1790391721.820154:0:22755:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1790391721.820630:0:22755:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790391721.821454:0:22755:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1790391721.821462:0:22755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1790391721.830242:0:22755:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1790391721.830263:0:22755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1790391721.831564:0:22755:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1790391721.831578:0:22755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1790391721.832990:0:22755:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1790391721.833021:0:22755:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.128@tcp' 00000020:01000004:3.0:1790391721.833024:0:22755:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1790391721.833060:0:22755:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.128@tcp (typ=mgc) 00000020:00000080:3.0:1790391721.833077:0:22755:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.128@tcp (ffff9e52b9d719c0) 00000020:00000080:3.0:1790391721.833097:0:22755:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1790391721.833195:0:22755:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e52b562b000@MGC192.168.202.128@tcp: add connection 192.168.202.128@tcp at head 00010000:00010000:3.0:1790391721.833415:0:22755:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.128@tcp-0 is initialized 00000040:01000000:3.0:1790391721.833423:0:22755:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.128@tcp ctxt 1 is initialized 00000100:00080000:2.0:1790391721.834826:0:22772:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1790391721.835336:0:22773:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1790391721.835437:0:22755:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.128@tcp (uuid e907dcd1-fffe-43bb-853f-376b925bb229) 00000020:00000080:0.0:1790391721.835470:0:22755:0:(genops.c:1385:class_connect()) connect: client e907dcd1-fffe-43bb-853f-376b925bb229, cookie 0x2b1b7949f13e28e0 00000100:00080000:0.0:1790391721.835488:0:22755:0:(import.c:545:import_select_connection()) MGC192.168.202.128@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790391721.835496:0:22755:0:(import.c:665:import_select_connection()) MGC192.168.202.128@tcp: import ffff9e52b562b000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:0.0:1790391721.835551:0:22755:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e51838f6d80 x1877361186545280/t0(0) o250->MGC192.168.202.128@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790391721.835760:0:22755:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import e907dcd1-fffe-43bb-853f-376b925bb229->MGS 00000020:01000004:0.0:1790391721.835831:0:22755:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1790391721.835838:0:22755:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1790391721.835859:0:22755:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9e5182df3380) 00000020:00000080:0.0:1790391721.835921:0:22755:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1790391721.837860:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e907dcd1-fffe-43bb-853f-376b925bb229:3636:1877361186545280:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1790391721.838000:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391721.845799:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186545280 00000100:00100000:3.0:1790391721.845840:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186545280 00000100:00100000:3.0:1790391721.846107:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790391721.846121:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b778f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3636:x1877361186545280:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1790391721.846165:0:22769:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from e907dcd1-fffe-43bb-853f-376b925bb229@0@lo t0 exp 0000000000000000 cur 635 last 0 00000020:00000080:3.0:1790391721.846207:0:22769:0:(genops.c:1385:class_connect()) connect: client e907dcd1-fffe-43bb-853f-376b925bb229, cookie 0x2b1b7949f13e28ee 00000100:00080000:3.0:1790391721.846398:0:22769:0:(import.c:65:import_set_state_nolock()) ffff9e52b562c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790391721.846526:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b778f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+5:3636:x1877361186545280:12345-0@lo:250:mount.lustre.0 Request processed in 405us (8523us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391721.846536:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790391721.846576:0:3636:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.128@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1790391721.846594:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.128@tcp: connect to target with instance 0 00000100:00080000:1.0:1790391721.846606:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.202.128@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1790391721.846613:0:3636:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1790391721.846756:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e52b562b000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1790391721.846761:0:3636:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1790391721.846778:0:3636:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1790391721.846787:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e907dcd1-fffe-43bb-853f-376b925bb229:3636:1877361186545280:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1790391721.882934:0:22755:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790391721.883168:0:22755:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1790391721.883177:0:22755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1790391721.885129:0:22755:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1790391721.885151:0:22755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1790391721.890573:0:22755:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1790391721.890607:0:22755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1790391721.894494:0:22755:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790391721.894807:0:22755:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1790391721.894827:0:22755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1790391721.899972:0:22755:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1790391721.899994:0:22755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1790391722.004378:0:22755:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790391722.004622:0:22755:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1790391722.004629:0:22755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1790391722.018751:0:22755:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1790391722.018784:0:22755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1790391722.019967:0:22755:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790391722.020490:0:22755:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790391722.020499:0:22755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1790391722.022686:0:22755:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790391722.022705:0:22755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1790391722.038389:0:22755:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790391722.038602:0:22755:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790391722.038609:0:22755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1790391722.045856:0:22755:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790391722.045910:0:22755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1790391722.047413:0:22755:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790391722.047766:0:22755:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790391722.047774:0:22755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1790391722.049826:0:22755:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790391722.049842:0:22755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1790391722.139133:0:22755:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790391722.141524:0:22755:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1790391722.141539:0:22755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1790391722.144280:0:22755:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1790391722.144294:0:22755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1790391722.146086:0:22755:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1790391722.146098:0:22755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1790391722.148053:0:22755:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1790391722.148087:0:22755:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1790391722.148094:0:22755:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.128@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1790391722.148241:0:22755:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.128@tcp ctxt 0 is initialized 00000020:01000004:0.0:1790391722.148280:0:22755:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.128@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1790391722.148289:0:22755:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1790391722.148290:0:22755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790391722.148291:0:22755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790391722.148292:0:22755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790391722.148293:0:22755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790391722.148294:0:22755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790391722.148296:0:22755:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790391722.148297:0:22755:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790391722.148298:0:22755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790391722.148299:0:22755:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790391722.148302:0:22755:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1790391722.148303:0:22755:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790391722.148304:0:22755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790391722.148305:0:22755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790391722.148306:0:22755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790391722.148307:0:22755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790391722.148308:0:22755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790391722.148309:0:22755:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790391722.148310:0:22755:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790391722.148311:0:22755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790391722.148311:0:22755:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790391722.148364:0:22755:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1790391722.148386:0:22755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:22755:1877361186545408:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790391722.148472:0:22755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391722.148560:0:22755:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528330dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391722.149216:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186545408 00000100:00100000:3.0:1790391722.149233:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186545408 00000100:00100000:3.0:1790391722.149333:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790391722.149345:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b778f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+5:22755:x1877361186545408:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790391722.149401:0:22771:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1790391722.149404:0:22771:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1790391722.149407:0:22771:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1790391722.152661:0:22792:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1790391722.153979:0:22771:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:1.0:1790391722.157557:0:22793:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1790391722.157566:0:22793:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1790391722.157570:0:22793:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1790391722.157573:0:22793:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1790391722.157935:0:22793:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1790391722.158140:0:22771:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1790391722.158150:0:22771:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1790391722.165376:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b778f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+5:22755:x1877361186545408:12345-0@lo:253:mount.lustre.0 Request processed in 16022us (16892us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391722.165455:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790391722.166204:0:22755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:22755:1877361186545408:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790391722.166220:0:22755:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1790391722.166223:0:22755:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790391722.166225:0:22755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790391722.166226:0:22755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790391722.166227:0:22755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790391722.166229:0:22755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790391722.166230:0:22755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790391722.166231:0:22755:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790391722.166232:0:22755:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790391722.166234:0:22755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790391722.166235:0:22755:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790391722.166255:0:22755:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e52b56dd000 from lustre-MDT0000 10000000:01000000:2.0:1790391722.166290:0:22755:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1790391722.166293:0:22755:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1790391722.166297:0:22755:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9e52b9d719c0 10000000:01000000:2.0:1790391722.166300:0:22755:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790391722.166308:0:22755:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9e52b9d719c0 from 1 10000000:01000000:2.0:1790391722.166311:0:22755:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790391722.166579:0:22755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e518309d400/0x2b1b7949f13e28f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391722.166590:0:22755:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e518309d400/0x2b1b7949f13e28f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391722.166606:0:22755:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e518309d400/0x2b1b7949f13e28f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391722.166628:0:22755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:22755:1877361186545536:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790391722.166675:0:22755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391722.166827:0:22755:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e967600 going to sleep for 11 seconds 00000100:00100000:0.0:1790391722.179087:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186545536 00000100:00100000:0.0:1790391722.179104:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186545536 00000100:00100000:0.0:1790391722.179170:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790391722.179181:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b778d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+5:22755:x1877361186545536:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790391722.179198:0:22770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391722.179220:0:22770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5295144a00/0x2b1b7949f13e28fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e28f5 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391722.179246:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5295144a00/0x2b1b7949f13e28fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e28f5 expref: 6 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391722.179277:0:22770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5295144a00/0x2b1b7949f13e28fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e28f5 expref: 6 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391722.179286:0:22770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5295144a00, rc 0) 00000100:00100000:0.0:1790391722.179377:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b778d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+6:22755:x1877361186545536:12345-0@lo:101:mount.lustre.0 Request processed in 198us (12701us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391722.179385:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790391722.179851:0:22755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:22755:1877361186545536:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790391722.179870:0:22755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e518309d400/0x2b1b7949f13e28f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e28fc expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391722.179918:0:22755:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e518309d400/0x2b1b7949f13e28f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e28fc expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391722.180015:0:22755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:22755:1877361186545664:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790391722.180052:0:22755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391722.180083:0:22755:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e967600 going to sleep for 11 seconds 00000100:00100000:1.0:1790391722.180262:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186545664 00000100:00100000:1.0:1790391722.180268:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186545664 00000100:00100000:1.0:1790391722.180305:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790391722.180312:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b778c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+6:22755:x1877361186545664:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790391722.180409:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b778c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+6:22755:x1877361186545664:12345-0@lo:501:mount.lustre.0 Request processed in 96us (355us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790391722.180415:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790391722.180541:0:22755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:22755:1877361186545664:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1790391722.180566:0:22755:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1790391722.180582:0:22755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e518309d400/0x2b1b7949f13e28f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e28fc expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391722.180590:0:22755:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e518309d400/0x2b1b7949f13e28f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e28fc expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391722.180601:0:22755:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e52b56dd000 10000000:01000000:2.0:1790391722.180606:0:22755:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790391722.180621:0:22755:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9e52b56dd000 10000000:01000000:2.0:1790391722.180624:0:22755:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1790391722.180628:0:22755:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9e52b56dd000 from 1 10000000:01000000:2.0:1790391722.180630:0:22755:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1790391722.180651:0:22755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e518309ce00/0x2b1b7949f13e2903 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391722.180658:0:22755:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e518309ce00/0x2b1b7949f13e2903 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391722.180679:0:22755:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e518309ce00/0x2b1b7949f13e2903 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391722.180693:0:22755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:22755:1877361186545792:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790391722.180857:0:22755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391722.180993:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186545792 00000100:00100000:1.0:1790391722.180998:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186545792 00000100:00100000:1.0:1790391722.181024:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790391722.181031:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b778e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+6:22755:x1877361186545792:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790391722.181038:0:22770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391722.181053:0:22770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5184055800/0x2b1b7949f13e290a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e2903 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391722.181071:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5184055800/0x2b1b7949f13e290a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e2903 expref: 7 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391722.181081:0:22770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5184055800/0x2b1b7949f13e290a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2903 expref: 7 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391722.181089:0:22770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5184055800, rc 0) 00000100:00100000:1.0:1790391722.181115:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b778e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+7:22755:x1877361186545792:12345-0@lo:101:mount.lustre.0 Request processed in 85us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391722.181132:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790391722.181229:0:22755:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e967600 going to sleep for 11 seconds 00000100:00100000:2.0:1790391722.181242:0:22755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:22755:1877361186545792:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790391722.181255:0:22755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e518309ce00/0x2b1b7949f13e2903 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e290a expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391722.181262:0:22755:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e518309ce00/0x2b1b7949f13e2903 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e290a expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391722.181272:0:22755:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1790391722.181276:0:22755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e518309ce00/0x2b1b7949f13e2903 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e290a expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391722.181282:0:22755:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e518309ce00/0x2b1b7949f13e2903 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e290a expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391722.181299:0:22755:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1790391722.181302:0:22755:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790391722.181306:0:22755:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9e52b56dd000 10000000:01000000:2.0:1790391722.181308:0:22755:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1790391722.181311:0:22755:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1790391722.181314:0:22755:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1790391722.181340:0:22755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e518309c000/0x2b1b7949f13e2911 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391722.181347:0:22755:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e518309c000/0x2b1b7949f13e2911 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391722.181355:0:22755:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e518309c000/0x2b1b7949f13e2911 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391722.181366:0:22755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:22755:1877361186545920:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790391722.188096:0:22755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391722.188178:0:22755:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e967600 going to sleep for 11 seconds 00000100:00100000:1.0:1790391722.188354:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186545920 00000100:00100000:1.0:1790391722.188363:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186545920 00000100:00100000:1.0:1790391722.188437:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790391722.188446:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+7:22755:x1877361186545920:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790391722.188478:0:22770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391722.188498:0:22770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5184054400/0x2b1b7949f13e2918 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e2911 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391722.188529:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5184054400/0x2b1b7949f13e2918 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e2911 expref: 8 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391722.188541:0:22770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5184054400/0x2b1b7949f13e2918 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2911 expref: 8 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391722.188550:0:22770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5184054400, rc 0) 00000100:00100000:1.0:1790391722.188626:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+8:22755:x1877361186545920:12345-0@lo:101:mount.lustre.0 Request processed in 180us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391722.188633:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790391722.188939:0:22755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:22755:1877361186545920:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790391722.188958:0:22755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e518309c000/0x2b1b7949f13e2911 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2918 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391722.188969:0:22755:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e518309c000/0x2b1b7949f13e2911 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e2918 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391722.189053:0:22755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:22755:1877361186546048:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790391722.189088:0:22755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391722.189103:0:22755:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528330d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391722.189311:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186546048 00000100:00100000:2.0:1790391722.189316:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186546048 00000100:00100000:2.0:1790391722.189356:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790391722.189363:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+8:22755:x1877361186546048:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790391722.189511:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+9:22755:x1877361186546048:12345-0@lo:501:mount.lustre.0 Request processed in 147us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391722.189518:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790391722.189641:0:22755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:22755:1877361186546048:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790391722.189686:0:22755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:22755:1877361186546176:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790391722.189954:0:22755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391722.189974:0:22755:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528330d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391722.190111:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186546176 00000100:00100000:3.0:1790391722.190124:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186546176 00000100:00100000:3.0:1790391722.190186:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790391722.190197:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+9:22755:x1877361186546176:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790391722.191434:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+9:22755:x1877361186546176:12345-0@lo:503:mount.lustre.0 Request processed in 1234us (1474us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391722.191448:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790391722.191549:0:22755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:22755:1877361186546176:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790391722.193353:0:22794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e907dcd1-fffe-43bb-853f-376b925bb229:22794:1877361186546304:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790391722.193487:0:22794:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391722.193538:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528330df00 going to sleep for 11 seconds 00000100:00100000:1.0:1790391722.194552:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186546304 00000100:00100000:1.0:1790391722.194563:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186546304 00000100:00100000:1.0:1790391722.194620:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790391722.194631:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+9:22794:x1877361186546304:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790391722.197782:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+9:22794:x1877361186546304:12345-0@lo:502:llog_process_th.0 Request processed in 3142us (4283us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391722.197798:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790391722.198283:0:22794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e907dcd1-fffe-43bb-853f-376b925bb229:22794:1877361186546304:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790391722.198322:0:22794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790391722.198343:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391722.198346:0:22794:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1790391722.198352:0:22794:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1790391722.198355:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790391722.198373:0:22794:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9e5182df19c0) 00000020:00000080:0.0:1790391722.198404:0:22794:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1790391722.198411:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1790391722.198518:0:22794:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1790391722.198527:0:22794:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2b1b7949f13e2926 00000020:00000080:0.0:1790391722.198747:0:22794:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1790391722.198752:0:22794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790391722.198755:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391722.198757:0:22794:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1790391722.198760:0:22794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790391722.198763:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391722.198765:0:22794:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1790391722.198768:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790391722.198776:0:22794:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9e5182df0000) 00000020:00000080:0.0:1790391722.198785:0:22794:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1790391722.198789:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1790391722.198790:0:22794:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1790391722.198794:0:22794:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1790391722.198800:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790391722.198845:0:22794:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e52b56dd000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1790391722.198859:0:22794:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9e5182df4d40) 00000020:00000080:0.0:1790391722.198867:0:22794:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1790391722.198938:0:22794:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1790391722.198943:0:22794:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2b1b7949f13e293b 00000020:00000080:0.0:1790391722.199025:0:22794:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1790391722.199036:0:22794:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1790391722.199041:0:22794:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x2b1b7949f13e2942 00080000:01000000:0.0:1790391722.199046:0:22794:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1790391722.199049:0:22794:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2b1b7949f13e2949 00010000:00010000:2.0:1790391722.410375:0:22794:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1790391722.412145:0:22794:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:2.0:1790391722.412726:0:22794:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1790391722.413843:0:22794:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9e5290bf3380) 00000020:00000080:2.0:1790391722.413863:0:22794:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1790391722.413970:0:22794:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1790391722.413978:0:22794:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2b1b7949f13e2957 00000020:00000080:3.0:1790391722.420498:0:22794:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1790391722.447674:0:22794:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x2b1b7949f13e295e 00000020:00000080:0.0:1790391722.448291:0:22794:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1790391722.448302:0:22794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790391722.448308:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391722.448310:0:22794:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1790391722.448313:0:22794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1790391722.448315:0:22794:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1790391722.448317:0:22794:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790391722.448318:0:22794:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790391722.448320:0:22794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1790391722.448333:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391722.448335:0:22794:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1790391722.448337:0:22794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790391722.448343:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391722.448345:0:22794:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1790391722.448349:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1790391722.448710:0:22794:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1790391722.448728:0:22794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790391722.448733:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391722.448734:0:22794:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1790391722.448737:0:22794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790391722.448740:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391722.448741:0:22794:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1790391722.448744:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790391722.448749:0:22794:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.128@tcp to nid 0x20000c0a8ca80 (192.168.202.128@tcp) 00000020:00000080:0.0:1790391722.448777:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790391722.448794:0:22794:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9e5183383380) 00000020:00000080:0.0:1790391722.449167:0:22794:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1790391722.449175:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790391722.449248:0:22794:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1790391722.449254:0:22794:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1790391722.449261:0:22794:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2b1b7949f13e296c 00010000:00080000:0.0:1790391722.449295:0:22794:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e52b5cfb000@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.128@tcp at head 00010000:00010000:0.0:1790391722.457645:0:22794:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1790391722.460046:0:22794:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790391722.460062:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1790391722.460097:0:22794:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1790391722.460117:0:22794:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2b1b7949f13e2973 00000100:00080000:3.0:1790391722.460128:0:22794:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790391722.460134:0:22794:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9e52b5cfb000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:3.0:1790391722.460173:0:22794:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e52bb398000 x1877361186546432/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790391722.460199:0:22794:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1790391722.460303:0:22794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790391722.460306:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391722.460313:0:22794:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1790391722.460317:0:22794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1790391722.460320:0:22794:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1790391722.460331:0:22794:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790391722.460334:0:22794:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790391722.460335:0:22794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1790391722.460338:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391722.460340:0:22794:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1790391722.460342:0:22794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790391722.460347:0:22794:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1790391722.460350:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391722.460352:0:22794:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1790391722.460355:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790391722.460358:0:22794:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.128@tcp to nid 0x20000c0a8ca80 (192.168.202.128@tcp) 00000020:01000000:3.0:1790391722.460380:0:22794:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1790391722.460382:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790391722.460402:0:22794:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9e52b9d70000) 00000020:00000080:3.0:1790391722.460413:0:22794:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1790391722.460417:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790391722.460479:0:22794:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1790391722.460484:0:22794:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:3.0:1790391722.460490:0:22794:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2b1b7949f13e2981 00010000:00080000:3.0:1790391722.460517:0:22794:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e528493f000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.128@tcp at head 00010000:00010000:3.0:1790391722.460699:0:22794:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:1.0:1790391722.461065:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186546432:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790391722.461132:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391722.461194:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186546432 00000100:00100000:1.0:1790391722.461200:0:22781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186546432 00000100:00100000:1.0:1790391722.461225:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790391722.461231:0:22781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518331ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1877361186546432:12345-0@lo:38:llog_process_th.0 00010000:00020000:1.0:1790391722.461252:0:22781:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:2.0:1790391722.465725:0:22794:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1790391722.468161:0:22794:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1790391722.474524:0:22794:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790391722.475276:0:22794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1790391722.490802:0:22794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000100:00100000:1.0:1790391722.494006:0:22781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518331ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1877361186546432:12345-0@lo:38:llog_process_th.0 Request processed in 32765us (32865us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790391722.494022:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1790391722.494839:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e52b5cfb000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790391722.494845:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790391722.494850:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186546432:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1790391722.495186:0:22800:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1790391722.495192:0:22800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1790391722.497225:0:22794:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790391722.497240:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790391722.497283:0:22794:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1790391722.497304:0:22794:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2b1b7949f13e2988 00000100:00080000:2.0:1790391722.497315:0:22794:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790391722.497335:0:22794:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e528493f000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:2.0:1790391722.497372:0:22794:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e51820ae680 x1877361186546560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790391722.497501:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186546560:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1790391722.497567:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877361186546560 offset 0 length 520: 4 00000100:00080000:2.0:1790391722.497624:0:22794:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1790391722.497687:0:22794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790391722.497692:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391722.497694:0:22794:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1790391722.497712:0:22794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790391722.497716:0:22794:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1790391722.497717:0:22794:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790391722.497719:0:22794:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790391722.497720:0:22794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790391722.497723:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391722.497724:0:22794:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790391722.497734:0:22794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790391722.497738:0:22794:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1790391722.497741:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391722.497743:0:22794:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1790391722.497745:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790391722.497749:0:22794:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.128@tcp to nid 0x20000c0a8ca80 (192.168.202.128@tcp) 00000020:01000000:2.0:1790391722.497771:0:22794:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1790391722.497774:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790391722.497786:0:22794:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9e5290bf4d40) 00000020:00000080:2.0:1790391722.497984:0:22794:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1790391722.497992:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790391722.498059:0:22794:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1790391722.498066:0:22794:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:2.0:1790391722.498072:0:22794:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2b1b7949f13e2996 00010000:00080000:2.0:1790391722.498100:0:22794:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e528493c000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.128@tcp at head 00010000:00010000:2.0:1790391722.498357:0:22794:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1790391722.498647:0:22794:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1790391722.498663:0:22794:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1790391722.501577:0:22794:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790391722.502146:0:22794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1790391722.502300:0:22794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:1.0:1790391722.503086:0:22802:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1790391722.503092:0:22802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1790391722.504522:0:22794:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790391722.504538:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1790391722.504580:0:22794:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1790391722.504604:0:22794:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2b1b7949f13e299d 00000100:00080000:3.0:1790391722.504616:0:22794:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790391722.504634:0:22794:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e528493c000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:3.0:1790391722.504669:0:22794:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e52bb398a80 x1877361186546688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790391722.504744:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb398a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186546688:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1790391722.504814:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877361186546688 offset 0 length 520: 4 00000100:00080000:3.0:1790391722.505191:0:22794:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1790391722.505252:0:22794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790391722.505257:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391722.505260:0:22794:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1790391722.505263:0:22794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790391722.505267:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391722.505268:0:22794:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790391722.505272:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790391722.505274:0:22794:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1790391722.505278:0:22794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790391722.505279:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391722.505281:0:22794:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1790391722.505283:0:22794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790391722.505285:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391722.505287:0:22794:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1790391722.505290:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1790391722.505335:0:22794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb399500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e907dcd1-fffe-43bb-853f-376b925bb229:22794:1877361186546816:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790391722.505554:0:22794:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391722.505590:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51823da780 going to sleep for 11 seconds 00000100:00100000:2.0:1790391722.505655:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186546816 00000100:00100000:2.0:1790391722.505664:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186546816 00000100:00100000:2.0:1790391722.506046:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790391722.506057:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+9:22794:x1877361186546816:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790391722.506190:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+9:22794:x1877361186546816:12345-0@lo:502:llog_process_th.0 Request processed in 135us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391722.506198:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790391722.506373:0:22794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb399500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e907dcd1-fffe-43bb-853f-376b925bb229:22794:1877361186546816:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790391722.506493:0:22794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790391722.506498:0:22794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391722.506500:0:22794:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1790391722.506504:0:22794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1790391722.506675:0:22755:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1790391722.507011:0:22755:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1790391722.507033:0:22755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e518309c000/0x2b1b7949f13e2911 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2918 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391722.507055:0:22755:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e518309c000/0x2b1b7949f13e2911 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2918 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391722.507127:0:22755:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e52b56dd000 from 1 10000000:01000000:3.0:1790391722.507130:0:22755:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790391722.507166:0:22755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c800/0x2b1b7949f13e29a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391722.507179:0:22755:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c800/0x2b1b7949f13e29a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391722.507188:0:22755:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c800/0x2b1b7949f13e29a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391722.507206:0:22755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb399500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:22755:1877361186546944:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790391722.507243:0:22755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391722.507279:0:22755:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51823da780 going to sleep for 11 seconds 00000100:00100000:1.0:1790391722.507341:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186546944 00000100:00100000:1.0:1790391722.507347:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186546944 00000100:00100000:1.0:1790391722.507384:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790391722.507401:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+9:22755:x1877361186546944:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790391722.507411:0:22770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391722.507424:0:22770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5184054800/0x2b1b7949f13e29ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e29a4 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391722.507445:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5184054800/0x2b1b7949f13e29ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e29a4 expref: 10 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391722.507456:0:22770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5184054800/0x2b1b7949f13e29ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e29a4 expref: 10 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391722.507466:0:22770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5184054800, rc 0) 00000100:00100000:1.0:1790391722.507507:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+10:22755:x1877361186546944:12345-0@lo:101:mount.lustre.0 Request processed in 108us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391722.507513:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790391722.507638:0:22755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb399500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:22755:1877361186546944:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790391722.507653:0:22755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c800/0x2b1b7949f13e29a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e29ab expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391722.507663:0:22755:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c800/0x2b1b7949f13e29a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e29ab expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391722.508580:0:22755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb399500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:22755:1877361186547072:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1790391722.508631:0:22755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391722.508720:0:22755:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51823da780 going to sleep for 11 seconds 00000100:00100000:1.0:1790391722.509188:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186547072 00000100:00100000:1.0:1790391722.509195:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186547072 00000100:00100000:1.0:1790391722.509242:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790391722.509251:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+10:22755:x1877361186547072:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1790391722.509275:0:22771:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1790391722.509281:0:22771:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1790391722.509539:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+10:22755:x1877361186547072:12345-0@lo:256:mount.lustre.0 Request processed in 288us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391722.509547:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790391722.509691:0:22755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb399500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:22755:1877361186547072:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1790391722.510580:0:22755:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790391722.510647:0:22755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c800/0x2b1b7949f13e29a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e29ab expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391722.510658:0:22755:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c800/0x2b1b7949f13e29a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e29ab expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391722.510679:0:22755:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e52b56dd000 from 1 10000000:01000000:3.0:1790391722.510681:0:22755:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790391722.510786:0:22755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52bab9ce00/0x2b1b7949f13e29b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391722.510863:0:22755:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e52bab9ce00/0x2b1b7949f13e29b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391722.510874:0:22755:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52bab9ce00/0x2b1b7949f13e29b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391722.510989:0:22755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb399500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:22755:1877361186547200:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790391722.511040:0:22755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391722.511070:0:22755:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51823da780 going to sleep for 11 seconds 00000100:00100000:1.0:1790391722.511316:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186547200 00000100:00100000:1.0:1790391722.511333:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186547200 00000100:00100000:1.0:1790391722.511400:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790391722.511411:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+10:22755:x1877361186547200:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790391722.511422:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391722.511438:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5184055a00/0x2b1b7949f13e29b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e29b2 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391722.511461:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5184055a00/0x2b1b7949f13e29b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e29b2 expref: 11 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391722.511471:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5184055a00/0x2b1b7949f13e29b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e29b2 expref: 11 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391722.511481:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5184055a00, rc 0) 00000100:00100000:1.0:1790391722.511527:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+11:22755:x1877361186547200:12345-0@lo:101:mount.lustre.0 Request processed in 119us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391722.511534:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790391722.511829:0:22755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb399500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:22755:1877361186547200:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790391722.511843:0:22755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52bab9ce00/0x2b1b7949f13e29b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e29b9 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391722.511851:0:22755:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52bab9ce00/0x2b1b7949f13e29b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e29b9 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391722.512126:0:22755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb399500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:22755:1877361186547328:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790391722.512155:0:22755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391722.512184:0:22755:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51823da780 going to sleep for 11 seconds 00000100:00100000:2.0:1790391722.512232:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186547328 00000100:00100000:2.0:1790391722.512237:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186547328 00000100:00100000:2.0:1790391722.512271:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790391722.512279:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282b66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+11:22755:x1877361186547328:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790391722.512522:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282b66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+11:22755:x1877361186547328:12345-0@lo:501:mount.lustre.0 Request processed in 243us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391722.512529:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790391722.512591:0:22755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb399500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:22755:1877361186547328:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790391722.512619:0:22755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb399500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:22755:1877361186547456:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790391722.512660:0:22755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391722.512680:0:22755:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51823da780 going to sleep for 11 seconds 00000100:00100000:2.0:1790391722.513084:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186547456 00000100:00100000:2.0:1790391722.513090:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186547456 00000100:00100000:2.0:1790391722.513123:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790391722.513131:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282bd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+11:22755:x1877361186547456:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790391722.513226:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282bd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+11:22755:x1877361186547456:12345-0@lo:503:mount.lustre.0 Request processed in 96us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391722.513233:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790391722.513353:0:22755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb399500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:22755:1877361186547456:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790391722.514262:0:22804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ad180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e907dcd1-fffe-43bb-853f-376b925bb229:22804:1877361186547584:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790391722.514305:0:22804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391722.514352:0:22804:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528881f300 going to sleep for 11 seconds 00000100:00100000:3.0:1790391722.514461:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186547584 00000100:00100000:3.0:1790391722.514467:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186547584 00000100:00100000:3.0:1790391722.514512:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790391722.514519:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282bdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+11:22804:x1877361186547584:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790391722.515519:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282bdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+11:22804:x1877361186547584:12345-0@lo:502:llog_process_th.0 Request processed in 996us (1208us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391722.515529:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790391722.521039:0:22804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ad180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e907dcd1-fffe-43bb-853f-376b925bb229:22804:1877361186547584:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790391722.527494:0:22804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790391722.527513:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391722.527515:0:22804:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790391722.527527:0:22804:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e52b56dd000 00000020:00000080:0.0:1790391722.527530:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790391722.527539:0:22804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790391722.527541:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391722.527542:0:22804:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1790391722.527545:0:22804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790391722.527547:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391722.527548:0:22804:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790391722.527552:0:22804:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e52b56dd000 00000020:00000080:0.0:1790391722.527555:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790391722.527622:0:22804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790391722.527626:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391722.527628:0:22804:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1790391722.527630:0:22804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790391722.527646:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391722.527648:0:22804:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790391722.527652:0:22804:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e52b56dd000 00000020:00000080:0.0:1790391722.527654:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790391722.527673:0:22804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790391722.527676:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391722.527677:0:22804:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790391722.527679:0:22804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790391722.527682:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391722.527683:0:22804:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1790391722.527686:0:22804:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e52b56dd000 00000020:00000080:0.0:1790391722.527688:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790391722.527760:0:22804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e907dcd1-fffe-43bb-853f-376b925bb229:22804:1877361186547712:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790391722.529592:0:22804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391722.529663:0:22804:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528330da80 going to sleep for 11 seconds 00000100:00100000:2.0:1790391722.529783:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186547712 00000100:00100000:2.0:1790391722.529806:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186547712 00000100:00100000:2.0:1790391722.529868:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790391722.529910:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282bda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+11:22804:x1877361186547712:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790391722.530065:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282bda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+11:22804:x1877361186547712:12345-0@lo:502:llog_process_th.0 Request processed in 187us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391722.530079:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790391722.530354:0:22804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e907dcd1-fffe-43bb-853f-376b925bb229:22804:1877361186547712:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790391722.530394:0:22804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790391722.530402:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391722.530404:0:22804:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1790391722.530409:0:22804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1790391722.531478:0:22755:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1790391722.531507:0:22755:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790391722.531533:0:22755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52bab9ce00/0x2b1b7949f13e29b2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e29b9 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391722.531545:0:22755:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e52bab9ce00/0x2b1b7949f13e29b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e29b9 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391722.531594:0:22755:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790391722.531597:0:22755:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e52b56dd000 10000000:01000000:2.0:1790391722.531599:0:22755:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e52b56dd000 10000000:01000000:2.0:1790391722.531603:0:22755:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790391722.531608:0:22755:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e52b56dd000 from 1 10000000:01000000:2.0:1790391722.531611:0:22755:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790391722.531643:0:22755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e518309dc00/0x2b1b7949f13e29c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391722.531652:0:22755:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e518309dc00/0x2b1b7949f13e29c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391722.531662:0:22755:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e518309dc00/0x2b1b7949f13e29c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391722.531683:0:22755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:22755:1877361186547840:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790391722.531742:0:22755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391722.531777:0:22755:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528881f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391722.532085:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186547840 00000100:00100000:3.0:1790391722.532092:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186547840 00000100:00100000:3.0:1790391722.532134:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790391722.532143:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282bda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+11:22755:x1877361186547840:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790391722.532155:0:22769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391722.532170:0:22769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52bab9d200/0x2b1b7949f13e29c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e29c0 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391722.532194:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52bab9d200/0x2b1b7949f13e29c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e29c0 expref: 12 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391722.532204:0:22769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52bab9d200/0x2b1b7949f13e29c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e29c0 expref: 12 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391722.532214:0:22769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52bab9d200, rc 0) 00000100:00100000:3.0:1790391722.532251:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282bda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+12:22755:x1877361186547840:12345-0@lo:101:mount.lustre.0 Request processed in 108us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391722.532269:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790391722.532375:0:22755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:22755:1877361186547840:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790391722.532463:0:22755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e518309dc00/0x2b1b7949f13e29c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e29c7 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391722.532483:0:22755:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e518309dc00/0x2b1b7949f13e29c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e29c7 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391722.532543:0:22755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:22755:1877361186547968:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790391722.532572:0:22755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391722.532637:0:22755:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528881f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391722.545860:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186547968 00000100:00100000:3.0:1790391722.545892:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186547968 00000100:00100000:3.0:1790391722.546846:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790391722.546858:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282bdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+12:22755:x1877361186547968:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790391722.547230:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282bdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+12:22755:x1877361186547968:12345-0@lo:501:mount.lustre.0 Request processed in 373us (14656us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391722.547238:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790391722.548124:0:22755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:22755:1877361186547968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790391722.548179:0:22755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb399500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:22755:1877361186548096:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790391722.548231:0:22755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391722.548263:0:22755:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51823da480 going to sleep for 11 seconds 00000100:00100000:3.0:1790391722.548281:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186548096 00000100:00100000:3.0:1790391722.548287:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186548096 00000100:00100000:3.0:1790391722.548315:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790391722.548333:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282bd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+12:22755:x1877361186548096:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790391722.549002:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282bd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+12:22755:x1877361186548096:12345-0@lo:503:mount.lustre.0 Request processed in 678us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391722.549011:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790391722.549967:0:22755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb399500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:22755:1877361186548096:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790391722.565195:0:22809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e907dcd1-fffe-43bb-853f-376b925bb229:22809:1877361186548224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790391722.565288:0:22809:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391722.565344:0:22809:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52ae87dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1790391722.565944:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186548224 00000100:00100000:0.0:1790391722.565952:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186548224 00000100:00100000:0.0:1790391722.565998:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790391722.566007:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+12:22809:x1877361186548224:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790391722.566146:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+12:22809:x1877361186548224:12345-0@lo:502:llog_process_th.0 Request processed in 139us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391722.566162:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790391722.566212:0:22809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e907dcd1-fffe-43bb-853f-376b925bb229:22809:1877361186548224:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1790391722.566267:0:22809:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1790391722.566281:0:22809:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9e5183384d40) 00000020:00000080:0.0:1790391722.566299:0:22809:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1790391722.566404:0:22809:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e52b56dd000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1790391722.566409:0:22809:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e52b56dd000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1790391722.566412:0:22809:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e52b56dd000 4 00010000:00080000:0.0:1790391722.566443:0:22809:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e51838d5000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.128@tcp at head 00010000:00010000:1.0:1790391722.578564:0:22809:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1790391722.580360:0:22809:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1790391722.581520:0:22809:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790391722.581537:0:22809:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x2b1b7949f13e29d5 00000100:00080000:1.0:1790391722.581549:0:22809:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790391722.581555:0:22809:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9e51838d5000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:1.0:1790391722.581591:0:22809:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e518331df80 x1877361186548352/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790391722.581618:0:22809:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1790391722.585372:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1877361186548352:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790391722.585480:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391722.585554:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186548352 00000100:00100000:0.0:1790391722.585563:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186548352 00000100:00100000:0.0:1790391722.585606:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790391722.585612:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1877361186548352:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790391722.585664:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1877361186548352:12345-0@lo:38:llog_process_th.0 Request processed in 50us (184us total) trans 0 rc -11/-11 00000100:00100000:0.0:1790391722.585670:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790391722.585704:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790391722.585713:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e51838d5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790391722.585717:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1790391722.585720:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1877361186548352:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790391722.589764:0:22809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e907dcd1-fffe-43bb-853f-376b925bb229:22809:1877361186548480:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790391722.589849:0:22809:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391722.589937:0:22809:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a76389c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391722.590330:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186548480 00000100:00100000:0.0:1790391722.590338:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186548480 00000100:00100000:0.0:1790391722.590402:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790391722.590412:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+12:22809:x1877361186548480:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790391722.590553:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+12:22809:x1877361186548480:12345-0@lo:502:llog_process_th.0 Request processed in 142us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391722.590561:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790391722.590720:0:22809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e907dcd1-fffe-43bb-853f-376b925bb229:22809:1877361186548480:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790391722.590767:0:22809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e907dcd1-fffe-43bb-853f-376b925bb229:22809:1877361186548608:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790391722.590803:0:22809:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391722.590830:0:22809:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a76389c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391722.590955:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186548608 00000100:00100000:3.0:1790391722.590961:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186548608 00000100:00100000:3.0:1790391722.590984:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790391722.590991:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+12:22809:x1877361186548608:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790391722.591063:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+12:22809:x1877361186548608:12345-0@lo:502:llog_process_th.0 Request processed in 72us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391722.591078:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790391722.591112:0:22809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e907dcd1-fffe-43bb-853f-376b925bb229:22809:1877361186548608:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1790391722.591131:0:22809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1790391722.591314:0:22755:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1790391722.591348:0:22755:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790391722.591371:0:22755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e518309dc00/0x2b1b7949f13e29c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e29c7 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391722.591392:0:22755:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e518309dc00/0x2b1b7949f13e29c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e29c7 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790391722.591440:0:22755:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790391722.591443:0:22755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790391722.591444:0:22755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790391722.591446:0:22755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790391722.591447:0:22755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790391722.591448:0:22755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790391722.591452:0:22755:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790391722.591453:0:22755:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790391722.591455:0:22755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790391722.591456:0:22755:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790391722.591460:0:22755:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1790391722.591462:0:22755:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790391722.591463:0:22755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790391722.591464:0:22755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790391722.591465:0:22755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790391722.591466:0:22755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790391722.591467:0:22755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790391722.591468:0:22755:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790391722.591469:0:22755:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790391722.591470:0:22755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790391722.591471:0:22755:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790391722.591482:0:22755:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1790391722.591490:0:22755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:22755:1877361186548736:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790391722.591517:0:22755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391722.591533:0:22755:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a76386c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391722.591546:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186548736 00000100:00100000:1.0:1790391722.591549:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186548736 00000100:00100000:1.0:1790391722.591565:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790391722.591570:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+12:22755:x1877361186548736:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790391722.591588:0:22769:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1790391722.591599:0:22769:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1790391722.604140:0:22769:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790391722.616535:0:22769:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1790391722.624212:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+12:22755:x1877361186548736:12345-0@lo:253:mount.lustre.0 Request processed in 32631us (32684us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391722.624225:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790391722.630961:0:22755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:22755:1877361186548736:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790391722.630984:0:22755:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1790391722.630987:0:22755:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790391722.630990:0:22755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790391722.630991:0:22755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790391722.630992:0:22755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790391722.630994:0:22755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790391722.630995:0:22755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790391722.630996:0:22755:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790391722.630998:0:22755:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790391722.631000:0:22755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790391722.631001:0:22755:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790391722.631018:0:22755:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1790391722.638560:0:22792:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790391722.638569:0:22792:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790391722.638594:0:22792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e518309d600/0x2b1b7949f13e29dc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391722.638613:0:22792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5184054800/0x2b1b7949f13e29ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e29a4 expref: 11 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391722.638622:0:22792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e518309d600/0x2b1b7949f13e29dc lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391722.638665:0:22792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5184054800/0x2b1b7949f13e29ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e29a4 expref: 11 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391722.638680:0:22792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e5184054800/0x2b1b7949f13e29ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e29a4 expref: 11 pid: 22770 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391722.638694:0:22792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820af100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22792:1877361186548864:0@lo:104: 00000100:00100000:2.0:1790391722.638762:0:22792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391722.638809:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528881f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391722.640867:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186548864 00000100:00100000:1.0:1790391722.641028:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186548864 00000100:00100000:1.0:1790391722.641088:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790391722.641097:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e907dcd1-fffe-43bb-853f-376b925bb229+3:22792:x1877361186548864:12345-0@lo:104: 00010000:00010000:1.0:1790391722.641125:0:22759:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c800/0x2b1b7949f13e29a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e29ab expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391722.641287:0:22759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790391722.641294:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e907dcd1-fffe-43bb-853f-376b925bb229+3:22792:x1877361186548864:12345-0@lo:104: Request processed in 198us (2532us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391722.641301:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1790391722.642055:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391722.642065:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c800/0x2b1b7949f13e29a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e29ab expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391722.642084:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52bab9c800 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:2.0:1790391722.642088:0:22765:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c800/0x2b1b7949f13e29a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e29ab expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391722.642098:0:22765:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c800/0x2b1b7949f13e29a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e29ab expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790391722.642104:0:22765:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c800/0x2b1b7949f13e29a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e29ab expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391722.642109:0:22765:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790391722.642147:0:22765:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c800/0x2b1b7949f13e29a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e29ab expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391722.642154:0:22765:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790391722.642175:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c800/0x2b1b7949f13e29a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e29ab expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391722.642181:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c800/0x2b1b7949f13e29a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e29ab expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391722.642199:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391722.642200:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391722.642202:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391722.642239:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e907dcd1-fffe-43bb-853f-376b925bb229:3639:1877361186548992:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790391722.642285:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391722.652216:0:22792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820af100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22792:1877361186548864:0@lo:104: 00010000:00010000:3.0:1790391722.652250:0:22792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e518309d600/0x2b1b7949f13e29dc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391722.652309:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186548992 00000100:00100000:3.0:1790391722.652316:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186548992 00010000:00010000:3.0:1790391722.652359:0:22761:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5184054800/0x2b1b7949f13e29ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e29a4 expref: 12 pid: 22770 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391722.652403:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790391722.652412:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e907dcd1-fffe-43bb-853f-376b925bb229+12:3639:x1877361186548992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790391722.652426:0:22761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391722.652432:0:22761:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5184054800/0x2b1b7949f13e29ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e29a4 expref: 12 pid: 22770 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391722.652444:0:22761:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5184054800/0x2b1b7949f13e29ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e29a4 expref: 12 pid: 22770 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391722.652461:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5184054800/0x2b1b7949f13e29ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e29a4 expref: 12 pid: 22770 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391722.652476:0:22761:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e518309d600/0x2b1b7949f13e29dc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391722.652484:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e518309d600/0x2b1b7949f13e29dc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790391722.652509:0:22761:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013940840s 00010000:00010000:3.0:1790391722.652513:0:22761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e518309d600/0x2b1b7949f13e29dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391722.652520:0:22761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e518309d600/0x2b1b7949f13e29dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391722.652526:0:22761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e518309d600/0x2b1b7949f13e29dc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391722.652533:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e518309d600/0x2b1b7949f13e29dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391722.652539:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309d600 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:3.0:1790391722.652544:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e518309d600/0x2b1b7949f13e29dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391722.652552:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e518309d600/0x2b1b7949f13e29dc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391722.652566:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e518309d600/0x2b1b7949f13e29dc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391722.652577:0:22761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391722.652647:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e907dcd1-fffe-43bb-853f-376b925bb229+11:3639:x1877361186548992:12345-0@lo:103:ldlm_bl.0 Request processed in 236us (10361us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391722.652655:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790391722.654049:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e907dcd1-fffe-43bb-853f-376b925bb229:3639:1877361186548992:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790391722.657610:0:22792:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e518309d600/0x2b1b7949f13e29dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391722.657648:0:22792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e518309d600/0x2b1b7949f13e29dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391722.657655:0:22792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e518309d600/0x2b1b7949f13e29dc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1790391722.677113:0:22755:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:2.0:1790391722.677700:0:22755:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1790391722.677781:0:22815:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:0.0:1790391722.677785:0:22815:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:0.0:1790391722.678114:0:22816:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1790391722.678376:0:22755:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:3.0:1790391722.678655:0:22816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:0.0:1790391722.680126:0:22817:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9e51838f7100 x1877361186549120/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391722.680139:0:22817:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e99b300 going to sleep for 0 seconds 00000040:01000000:2.0:1790391722.680767:0:22755:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1790391722.680819:0:22755:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790391722.683505:0:22816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1790391722.683606:0:22816:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00000080:2.0:1790391722.684944:0:22755:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1790391722.684965:0:22755:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1790391722.685070:0:22755:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790391722.687016:0:22755:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1790391722.687775:0:22755:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1790391722.687814:0:22755:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1790391722.695272:0:22755:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:0.0:1790391722.696542:0:22755:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:1.0:1790391722.715546:0:22755:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1790391722.719942:0:22755:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1790391722.720001:0:22755:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffab840163b988 00100000:10000000:1.0:1790391722.720010:0:22755:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1790391722.721678:0:22755:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790391722.721698:0:22755:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.128@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790391722.721719:0:22755:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1790391722.721736:0:22755:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1790391722.725574:0:22755:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790391722.725766:0:22755:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1790391722.829757:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790391722.927927:0:22773:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790391722.927936:0:22773:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e52b56dd000 from 11 10000000:01000000:2.0:1790391722.927942:0:22773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790391722.927991:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e518309d600/0x2b1b7949f13e29e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391722.928004:0:22773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e518309d600/0x2b1b7949f13e29e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391722.928019:0:22773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e518309d600/0x2b1b7949f13e29e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391722.928046:0:22773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820af480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186549248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790391722.928136:0:22773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391722.928180:0:22773:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52849e1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391722.928506:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186549248 00000100:00100000:1.0:1790391722.928515:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186549248 00000100:00100000:1.0:1790391722.928579:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790391722.928590:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+11:22773:x1877361186549248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790391722.928605:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391722.928620:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5184054000/0x2b1b7949f13e29ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e29e3 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391722.928645:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5184054000/0x2b1b7949f13e29ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e29e3 expref: 12 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391722.928657:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5184054000/0x2b1b7949f13e29ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e29e3 expref: 12 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391722.928678:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5184054000, rc 0) 00000100:00100000:1.0:1790391722.928726:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+12:22773:x1877361186549248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391722.928732:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790391722.928783:0:22773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820af480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186549248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790391722.928807:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e518309d600/0x2b1b7949f13e29e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e29ea expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391722.928817:0:22773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e518309d600/0x2b1b7949f13e29e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e29ea expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391722.928862:0:22773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186549376:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1790391722.928912:0:22773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391722.928926:0:22773:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51823a1180 going to sleep for 11 seconds 00000100:00100000:1.0:1790391722.928938:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186549376 00000100:00100000:1.0:1790391722.928942:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186549376 00000100:00100000:1.0:1790391722.928961:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790391722.928966:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+12:22773:x1877361186549376:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1790391722.928979:0:22769:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790391722.928994:0:22769:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790391722.928997:0:22769:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1790391722.929062:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+12:22773:x1877361186549376:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 95us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391722.929069:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790391722.929097:0:22773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186549376:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1790391722.929150:0:22773:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790391722.929157:0:22773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e518309d600/0x2b1b7949f13e29e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e29ea expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391722.929165:0:22773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e518309d600/0x2b1b7949f13e29e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e29ea expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790391723.594817:0:22810:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1790391723.594825:0:22810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790391723.611028:0:22810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1790391723.611052:0:22810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1790391723.720096:0:22817:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e99b300 going to sleep for 0 seconds 00010000:00010000:2.0:1790391723.848376:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790391724.618589:0:22810:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1790391724.618616:0:22810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790391724.618800:0:22810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:0.0:1790391724.619274:0:22810:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790391724.619451:0:22810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:0.0:1790391724.745976:0:22817:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e99b300 going to sleep for 0 seconds 00010000:00010000:0.0:1790391724.873868:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391725.767962:0:22817:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e99b300 going to sleep for 0 seconds 00010000:00010000:1.0:1790391725.897516:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391726.791953:0:22817:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e99b300 going to sleep for 0 seconds 00010000:00010000:0.0:1790391726.939121:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790391727.625421:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1790391727.625429:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1790391727.625433:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e52b5cfb000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790391727.625441:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 635 00000100:00080000:0.0:1790391727.625448:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790391727.625455:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9e52b5cfb000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:0.0:1790391727.625478:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e51838f4a80 x1877361186549632/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790391727.625495:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790391727.625499:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790391727.625501:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790391727.625504:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790391727.625507:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1790391727.625510:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790391727.625511:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e51838d5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790391727.625516:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9e51838d5000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:0.0:1790391727.625527:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e51838f7b80 x1877361186549760/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790391727.625560:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790391727.625577:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e907dcd1-fffe-43bb-853f-376b925bb229:3639:1877361186549504:0@lo:400:kworker.0 00000100:00100000:0.0:1790391727.625672:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391727.625738:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186549632:0@lo:38:kworker.0 00000100:00100000:0.0:1790391727.625766:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391727.625784:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1877361186549760:0@lo:38:kworker.0 00000100:00100000:0.0:1790391727.625807:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391727.625838:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186549504 00000100:00100000:0.0:1790391727.625845:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186549504 00000100:00100000:0.0:1790391727.625918:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790391727.625928:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+12:3639:x1877361186549504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391727.625974:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+12:3639:x1877361186549504:12345-0@lo:400:kworker.0 Request processed in 48us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391727.625981:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790391727.626022:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186549632 00000100:00100000:0.0:1790391727.626026:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186549632 00000100:00100000:0.0:1790391727.626044:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790391727.626048:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1877361186549632:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1790391727.626064:0:22782:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1790391727.626097:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1877361186549632:12345-0@lo:38:kworker.0 Request processed in 47us (330us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790391727.626104:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1790391727.626133:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e52b5cfb000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790391727.626137:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790391727.626141:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186549632:0@lo:38:kworker.0 00000100:00100000:0.0:1790391727.626207:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e907dcd1-fffe-43bb-853f-376b925bb229:3639:1877361186549504:0@lo:400:kworker.0 00000100:00100000:0.0:1790391727.626338:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186549760 00000100:00100000:0.0:1790391727.626342:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186549760 00000100:00100000:0.0:1790391727.626360:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790391727.626365:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1877361186549760:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1790391727.626381:0:22778:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 640 last 0 00000020:00000080:0.0:1790391727.626410:0:22778:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x2b1b7949f13e29f1 00000004:00100000:0.0:1790391727.626425:0:22778:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790391727.626561:0:22778:0:(import.c:65:import_set_state_nolock()) ffff9e5284984800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790391727.626603:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1877361186549760:12345-0@lo:38:kworker.0 Request processed in 236us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391727.626610:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790391727.626642:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e51838f7b80 x1877361186549760/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790391737 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790391727.626655:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1790391727.626662:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1790391727.626665:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790391727.626667:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e51838d5000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790391727.626672:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1877361186549760:0@lo:38:kworker.0 00000100:00100000:3.0:1790391727.825358:0:22817:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e99b300 going to sleep for 0 seconds 00010000:00010000:3.0:1790391727.947996:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391728.841921:0:22817:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e99b300 going to sleep for 0 seconds 00010000:00010000:2.0:1790391728.975017:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790391729.402657:0:23060:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg228-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1790391729.880554:0:22817:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e99b300 going to sleep for 0 seconds 00010000:00010000:2.0:1790391729.994929:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391730.888818:0:22817:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e99b300 going to sleep for 0 seconds 00000020:00000004:0.0:1790391730.992237:0:23114:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790391730.996133:0:23114:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790391731.016102:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391731.912978:0:22817:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e99b300 going to sleep for 0 seconds 00010000:00010000:2.0:1790391732.040341:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1790391732.421431:0:23164:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790391732.421670:0:23164:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1790391732.744494:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790391722/real 1790391722] req@ffff9e52bb398a80 x1877361186546688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391732 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391732.744530:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e52bb398a80 x1877361186546688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391732 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391732.744540:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790391722/real 1790391722] req@ffff9e51820ae680 x1877361186546560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391732 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391732.744551:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e51820ae680 x1877361186546560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391732 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790391732.744572:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e528493c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790391732.744581:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790391732.744585:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb398a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186546688:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1790391732.744591:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e528493f000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790391732.744596:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790391732.744600:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186546560:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1790391732.746054:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1790391732.746061:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1790391732.746066:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e52b5cfb000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790391732.746074:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 640 00000100:00080000:1.0:1790391732.746081:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1790391732.746091:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9e52b5cfb000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:1.0:1790391732.746119:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e518331fb80 x1877361186550016/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790391732.746137:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790391732.746140:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1790391732.746142:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e528493f000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790391732.746146:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 635 00000100:00080000:1.0:1790391732.746148:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1790391732.746162:0:38:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e528493f000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:1.0:1790391732.746178:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e518331f800 x1877361186550144/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790391732.746186:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790391732.746189:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1790391732.746191:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e528493c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790391732.746194:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 635 00000100:00080000:1.0:1790391732.746196:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1790391732.746200:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e528493c000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:1.0:1790391732.746210:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e518331ca80 x1877361186550272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790391732.746421:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186550016:0@lo:38:kworker.0 00000100:00100000:2.0:1790391732.746526:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391732.746591:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186550144:0@lo:8:kworker.0 00000400:00000100:2.0:1790391732.746617:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877361186550144 offset 0 length 520: 4 00000100:00100000:2.0:1790391732.747464:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186550272:0@lo:8:kworker.0 00000400:00000100:2.0:1790391732.747504:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877361186550272 offset 0 length 520: 4 00000100:00100000:2.0:1790391732.747571:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186550016 00000100:00100000:2.0:1790391732.747581:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186550016 00000100:00100000:2.0:1790391732.747630:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790391732.748422:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1877361186550016:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1790391732.748450:0:22782:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790391732.748530:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1877361186550016:12345-0@lo:38:kworker.0 Request processed in 113us (2003us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790391732.748539:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1790391732.748605:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e52b5cfb000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790391732.748611:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790391732.748615:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186550016:0@lo:38:kworker.0 00000100:00100000:1.0:1790391732.750677:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e907dcd1-fffe-43bb-853f-376b925bb229:3637:1877361186549888:0@lo:400:kworker.0 00000100:00100000:1.0:1790391732.750779:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391732.750848:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790391732.750856:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877361186550400:0@lo:400:kworker.0 00000100:00100000:1.0:1790391732.750913:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391732.750983:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186549888 00000100:00100000:1.0:1790391732.750992:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186549888 00000100:00100000:1.0:1790391732.751049:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790391732.751059:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+12:3637:x1877361186549888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391732.751136:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+12:3637:x1877361186549888:12345-0@lo:400:kworker.0 Request processed in 78us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391732.751145:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790391732.751205:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186550400 00000100:00100000:1.0:1790391732.751210:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186550400 00000100:00100000:1.0:1790391732.751251:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790391732.751265:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518331ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877361186550400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391732.751300:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518331ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877361186550400:12345-0@lo:400:kworker.0 Request processed in 37us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391732.751307:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1790391732.751357:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e518331dc00 x1877361186550400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391732.751374:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877361186550400:0@lo:400:kworker.0 00000100:00100000:1.0:1790391732.751385:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e907dcd1-fffe-43bb-853f-376b925bb229:3637:1877361186549888:0@lo:400:kworker.0 00000100:00100000:1.0:1790391732.936046:0:22817:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e99b300 going to sleep for 0 seconds 00010000:00010000:2.0:1790391733.064079:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391733.962351:0:22817:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e99b300 going to sleep for 0 seconds 00010000:00010000:3.0:1790391734.090248:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790391734.857091:0:22810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790391734.984013:0:22817:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e99b300 going to sleep for 0 seconds 00010000:00010000:2.0:1790391735.112319:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391736.025032:0:22817:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e99b300 going to sleep for 0 seconds 00010000:00010000:0.0:1790391736.139082:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391737.034170:0:22817:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e99b300 going to sleep for 0 seconds 00010000:00010000:2.0:1790391737.160050:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790391737.867141:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1790391737.867149:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1790391737.867153:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e52b5cfb000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790391737.867162:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 646 00000100:00080000:1.0:1790391737.867169:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1790391737.867175:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9e52b5cfb000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:1.0:1790391737.867211:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e518331dc00 x1877361186550656/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790391737.867228:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790391737.867231:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790391737.867234:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790391737.867236:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790391737.867267:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e907dcd1-fffe-43bb-853f-376b925bb229:3639:1877361186550528:0@lo:400:kworker.0 00000100:00100000:1.0:1790391737.867342:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391737.867411:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790391737.867417:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877361186550784:0@lo:400:kworker.0 00000100:00100000:1.0:1790391737.867520:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391737.867559:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186550656:0@lo:38:kworker.0 00000100:00100000:1.0:1790391737.867586:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391737.867620:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186550528 00000100:00100000:1.0:1790391737.867627:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186550528 00000100:00100000:1.0:1790391737.867667:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790391737.867676:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+12:3639:x1877361186550528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391737.867722:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+12:3639:x1877361186550528:12345-0@lo:400:kworker.0 Request processed in 47us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391737.867729:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790391737.867823:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186550784 00000100:00100000:1.0:1790391737.867828:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186550784 00000100:00100000:1.0:1790391737.867854:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790391737.867860:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518331c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877361186550784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391737.867912:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518331c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877361186550784:12345-0@lo:400:kworker.0 Request processed in 52us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391737.867918:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790391737.867935:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186550656 00000100:00100000:1.0:1790391737.867939:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186550656 00000100:00100000:1.0:1790391737.867956:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790391737.867961:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518331d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1877361186550656:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1790391737.867977:0:22782:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1790391737.868009:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518331d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1877361186550656:12345-0@lo:38:kworker.0 Request processed in 46us (421us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790391737.868014:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1790391737.868062:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e52b5cfb000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790391737.868068:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790391737.868071:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186550656:0@lo:38:kworker.0 00010000:00080000:1.0:1790391737.868102:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e518331e300 x1877361186550784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391737.868114:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877361186550784:0@lo:400:kworker.0 00000100:00100000:1.0:1790391737.868122:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e907dcd1-fffe-43bb-853f-376b925bb229:3639:1877361186550528:0@lo:400:kworker.0 00000100:00100000:0.0:1790391738.056354:0:22817:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e99b300 going to sleep for 0 seconds 00010000:00010000:0.0:1790391738.184196:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391739.088544:0:22817:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e99b300 going to sleep for 0 seconds 00010000:00010000:0.0:1790391739.210023:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391740.103960:0:22817:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e99b300 going to sleep for 0 seconds 00010000:00010000:0.0:1790391740.232492:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790391740.530152:0:23509:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790391740.530164:0:23509:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1790391740.530166:0:23509:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1790391740.530350:0:23509:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e5284985000 00000020:01000004:0.0:1790391740.530366:0:23509:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1790391740.530380:0:23509:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1790391740.530393:0:23509:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9e51833819c0) 00000020:00000080:0.0:1790391740.530409:0:23509:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1790391740.696839:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1790391740.701951:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1790391740.702682:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:0.0:1790391740.703443:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1790391740.703743:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1790391740.704182:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1790391740.704426:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1790391740.704670:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1790391740.705716:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1790391740.706933:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1790391740.707553:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1790391740.707829:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1790391740.708095:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1790391740.709237:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1790391740.709671:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1790391740.710493:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1790391740.710795:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1790391740.711138:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1790391740.711681:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1790391740.711970:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1790391740.712447:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1790391740.712644:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1790391740.712833:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1790391740.713113:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1790391740.713403:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1790391740.713599:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1790391740.713811:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1790391740.714022:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1790391740.714424:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1790391740.715070:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1790391740.728957:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1790391740.729613:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1790391740.729927:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1790391740.730307:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1790391740.735174:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1790391740.735478:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1790391740.736077:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1790391740.736437:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1790391740.736655:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1790391740.736908:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1790391740.737332:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1790391740.737533:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1790391740.737783:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1790391740.738119:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1790391740.738815:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1790391740.740811:0:23509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:01000000:3.0:1790391740.745579:0:23509:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1790391740.746568:0:23509:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1790391740.746588:0:23509:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790391740.746609:0:23509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2b1b7949f13e29ff 00000020:01000004:3.0:1790391740.746619:0:23509:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1790391740.746668:0:23509:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.128@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1790391740.746672:0:23509:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.128@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1790391740.746679:0:23509:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1790391740.746721:0:23509:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1790391740.746728:0:23509:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.128@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1790391740.771611:0:23509:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.128@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790391740.771674:0:23509:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.128@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1790391740.771679:0:23509:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790391740.771682:0:23509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1790391740.771683:0:23509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790391740.771684:0:23509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790391740.771686:0:23509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790391740.771687:0:23509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790391740.771689:0:23509:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790391740.771691:0:23509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790391740.771693:0:23509:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790391740.771698:0:23509:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1790391740.771701:0:23509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790391740.771702:0:23509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1790391740.771703:0:23509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790391740.771705:0:23509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790391740.771706:0:23509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790391740.771707:0:23509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790391740.771708:0:23509:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790391740.771715:0:23509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790391740.771716:0:23509:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790391740.773745:0:23509:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1790391740.773787:0:23509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186550912:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790391740.773931:0:23509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391740.774000:0:23509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52ae87d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391740.774137:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186550912 00000100:00100000:1.0:1790391740.774162:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186550912 00000100:00100000:1.0:1790391740.774235:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790391740.774247:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+12:23509:x1877361186550912:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790391740.774289:0:22770:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1790391740.774293:0:22770:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1790391740.774303:0:22770:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1790391740.775006:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+12:23509:x1877361186550912:12345-0@lo:253:mount.lustre.0 Request processed in 756us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391740.775018:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790391740.775617:0:23509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186550912:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790391740.775635:0:23509:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1790391740.775639:0:23509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790391740.775660:0:23509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1790391740.775661:0:23509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790391740.775663:0:23509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790391740.775664:0:23509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790391740.775666:0:23509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790391740.775667:0:23509:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790391740.775669:0:23509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790391740.775670:0:23509:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790391740.775698:0:23509:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e5284985000 from lustre-MDT0001 10000000:01000000:0.0:1790391740.775749:0:23509:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1790391740.775753:0:23509:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1790391740.775763:0:23509:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e52b9d719c0 local copy 00010000:00010000:0.0:1790391740.775778:0:23509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e518309d400/0x2b1b7949f13e28f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e28fc expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391740.783163:0:23509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186551040:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790391740.783275:0:23509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391740.783327:0:23509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52ae87d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391740.787302:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186551040 00000100:00100000:1.0:1790391740.787324:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186551040 00000100:00100000:1.0:1790391740.787416:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790391740.787430:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+12:23509:x1877361186551040:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790391740.787635:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+12:23509:x1877361186551040:12345-0@lo:501:mount.lustre.0 Request processed in 209us (4361us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790391740.787644:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790391740.787815:0:23509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186551040:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1790391740.787846:0:23509:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.128@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1790391740.787917:0:23509:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.128@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1790391740.787929:0:23509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e518309d400/0x2b1b7949f13e28f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e28fc expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391740.787943:0:23509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e518309d400/0x2b1b7949f13e28f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e28fc expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391740.787986:0:23509:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e5284985000 10000000:01000000:3.0:1790391740.787992:0:23509:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790391740.788000:0:23509:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9e52b9d719c0 10000000:01000000:3.0:1790391740.788005:0:23509:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1790391740.788009:0:23509:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e52b9d719c0 from 1 10000000:01000000:3.0:1790391740.788013:0:23509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1790391740.788058:0:23509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c000/0x2b1b7949f13e2a06 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391740.788067:0:23509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c000/0x2b1b7949f13e2a06 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391740.788078:0:23509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c000/0x2b1b7949f13e2a06 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391740.788105:0:23509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb39b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186551168:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790391740.788186:0:23509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391740.788232:0:23509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52888110c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391740.788782:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186551168 00000100:00100000:0.0:1790391740.788791:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186551168 00000100:00100000:0.0:1790391740.788905:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790391740.788916:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+12:23509:x1877361186551168:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790391740.788928:0:22769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391740.788948:0:22769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5295144e00/0x2b1b7949f13e2a0d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e2a06 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391740.788981:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5295144e00/0x2b1b7949f13e2a0d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e2a06 expref: 13 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391740.788995:0:22769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5295144e00/0x2b1b7949f13e2a0d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2a06 expref: 13 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391740.789020:0:22769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5295144e00, rc 0) 00000100:00100000:0.0:1790391740.789079:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+13:23509:x1877361186551168:12345-0@lo:101:mount.lustre.0 Request processed in 165us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391740.789086:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790391740.789194:0:23509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb39b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186551168:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790391740.789211:0:23509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c000/0x2b1b7949f13e2a06 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2a0d expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391740.789222:0:23509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c000/0x2b1b7949f13e2a06 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e2a0d expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391740.789244:0:23509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1790391740.789261:0:23509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c000/0x2b1b7949f13e2a06 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2a0d expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391740.789269:0:23509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c000/0x2b1b7949f13e2a06 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2a0d expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391740.789282:0:23509:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9e5284985000 10000000:01000000:3.0:1790391740.789298:0:23509:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1790391740.789303:0:23509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9e5284985000 from 1 10000000:01000000:3.0:1790391740.789306:0:23509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1790391740.789328:0:23509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c200/0x2b1b7949f13e2a14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391740.789336:0:23509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c200/0x2b1b7949f13e2a14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391740.789344:0:23509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c200/0x2b1b7949f13e2a14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391740.789363:0:23509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb39b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186551296:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790391740.789404:0:23509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391740.802779:0:23509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52888110c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391740.805718:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186551296 00000100:00100000:2.0:1790391740.805755:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186551296 00000100:00100000:2.0:1790391740.805860:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790391740.805874:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+13:23509:x1877361186551296:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790391740.805917:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391740.805946:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e518309c600/0x2b1b7949f13e2a1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e2a14 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391740.805989:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e518309c600/0x2b1b7949f13e2a1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e2a14 expref: 14 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391740.806004:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e518309c600/0x2b1b7949f13e2a1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2a14 expref: 14 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391740.806015:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309c600, rc 0) 00000100:00100000:3.0:1790391740.806675:0:23509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb39b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186551296:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790391740.806705:0:23509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c200/0x2b1b7949f13e2a14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2a1b expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391740.806717:0:23509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c200/0x2b1b7949f13e2a14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e2a1b expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391740.806755:0:23509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1790391740.806782:0:23509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c200/0x2b1b7949f13e2a14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2a1b expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391740.806792:0:23509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c200/0x2b1b7949f13e2a14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2a1b expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391740.806802:0:23509:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1790391740.806808:0:23509:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790391740.806816:0:23509:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9e5284985000 10000000:01000000:3.0:1790391740.806818:0:23509:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1790391740.806823:0:23509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1790391740.806826:0:23509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1790391740.806861:0:23509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52bab9da00/0x2b1b7949f13e2a22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391740.806870:0:23509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e52bab9da00/0x2b1b7949f13e2a22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391740.806901:0:23509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52bab9da00/0x2b1b7949f13e2a22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391740.806946:0:23509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb39b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186551424:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790391740.807306:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+14:23509:x1877361186551296:12345-0@lo:101:mount.lustre.0 Request processed in 1271us (17736us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391740.807319:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790391740.807831:0:23509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391740.807994:0:23509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52888110c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391740.809850:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186551424 00000100:00100000:1.0:1790391740.809871:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186551424 00000100:00100000:1.0:1790391740.810137:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790391740.810166:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+14:23509:x1877361186551424:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790391740.810188:0:22770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391740.810212:0:22770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5184054e00/0x2b1b7949f13e2a29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e2a22 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391740.810252:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5184054e00/0x2b1b7949f13e2a29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e2a22 expref: 15 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391740.810267:0:22770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5184054e00/0x2b1b7949f13e2a29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2a22 expref: 15 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391740.810279:0:22770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5184054e00, rc 0) 00000100:00100000:1.0:1790391740.810390:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+15:23509:x1877361186551424:12345-0@lo:101:mount.lustre.0 Request processed in 243us (2561us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391740.810397:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790391740.810527:0:23509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb39b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186551424:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790391740.810551:0:23509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52bab9da00/0x2b1b7949f13e2a22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2a29 expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391740.810563:0:23509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52bab9da00/0x2b1b7949f13e2a22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e2a29 expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790391740.812396:0:23509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:3.0:1790391740.814063:0:23509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790391740.833624:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1790391740.833717:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:3.0:1790391740.835631:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:3.0:1790391740.835691:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:3.0:1790391740.835707:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:3.0:1790391740.835720:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:3.0:1790391740.835745:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:3.0:1790391740.835761:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:3.0:1790391740.835778:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:3.0:1790391740.835793:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:3.0:1790391740.835813:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:3.0:1790391740.835829:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:3.0:1790391740.835857:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:3.0:1790391740.835873:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:3.0:1790391740.835924:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:3.0:1790391740.835939:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:3.0:1790391740.835956:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:3.0:1790391740.835991:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:3.0:1790391740.836008:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:3.0:1790391740.836022:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:3.0:1790391740.836034:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:3.0:1790391740.836046:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:3.0:1790391740.836058:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:3.0:1790391740.836072:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:3.0:1790391740.836085:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:3.0:1790391740.836097:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:3.0:1790391740.836113:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:3.0:1790391740.836140:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:3.0:1790391740.836172:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:3.0:1790391740.836188:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:3.0:1790391740.836202:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:3.0:1790391740.836215:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:3.0:1790391740.836230:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:3.0:1790391740.836245:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:3.0:1790391740.836257:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:3.0:1790391740.836270:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:3.0:1790391740.836286:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:3.0:1790391740.836298:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:3.0:1790391740.836309:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:3.0:1790391740.836320:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:3.0:1790391740.836331:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:3.0:1790391740.836342:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:3.0:1790391740.836353:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:3.0:1790391740.836367:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:3.0:1790391740.836406:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:3.0:1790391740.836412:0:23509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:3.0:1790391740.836567:0:23509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb39b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186551552:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790391740.836660:0:23509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391740.836709:0:23509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5288811000 going to sleep for 11 seconds 00000100:00100000:1.0:1790391740.837534:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186551552 00000100:00100000:1.0:1790391740.837549:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186551552 00000100:00100000:1.0:1790391740.837622:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790391740.837634:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+15:23509:x1877361186551552:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790391740.837866:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+15:23509:x1877361186551552:12345-0@lo:501:mount.lustre.0 Request processed in 234us (1205us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391740.837905:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790391740.838424:0:23509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb39b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186551552:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790391740.838487:0:23509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb39b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186551680:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790391740.838553:0:23509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391740.838591:0:23509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5288811000 going to sleep for 11 seconds 00000100:00100000:1.0:1790391740.838644:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186551680 00000100:00100000:1.0:1790391740.838651:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186551680 00000100:00100000:1.0:1790391740.838693:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790391740.838700:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+15:23509:x1877361186551680:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790391740.840022:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+15:23509:x1877361186551680:12345-0@lo:503:mount.lustre.0 Request processed in 1314us (1460us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391740.840037:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790391740.840376:0:23509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb39b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186551680:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790391740.841037:0:23509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790391740.842437:0:23509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb39b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186551808:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790391740.842558:0:23509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391740.842698:0:23509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52888110c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391740.845376:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186551808 00000100:00100000:2.0:1790391740.845399:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186551808 00000100:00100000:2.0:1790391740.845483:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790391740.845497:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+15:23509:x1877361186551808:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790391740.846728:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+15:23509:x1877361186551808:12345-0@lo:502:mount.lustre.0 Request processed in 1226us (4161us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391740.846802:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790391740.847437:0:23509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb39b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186551808:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790391740.848373:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1790391740.848424:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:3.0:1790391740.848436:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:3.0:1790391740.848447:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:3.0:1790391740.848459:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:3.0:1790391740.848471:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:3.0:1790391740.848481:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:3.0:1790391740.848495:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:3.0:1790391740.848506:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:3.0:1790391740.848517:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:3.0:1790391740.848528:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:3.0:1790391740.848539:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:3.0:1790391740.848549:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:3.0:1790391740.848560:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:3.0:1790391740.848570:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:3.0:1790391740.848582:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:3.0:1790391740.848592:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:3.0:1790391740.848602:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:3.0:1790391740.848626:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:3.0:1790391740.848638:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:3.0:1790391740.848649:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:3.0:1790391740.848660:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:3.0:1790391740.848670:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:3.0:1790391740.848682:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:3.0:1790391740.848693:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:3.0:1790391740.848704:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:3.0:1790391740.848715:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:3.0:1790391740.848726:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:2.0:1790391740.851727:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:2.0:1790391740.851933:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:2.0:1790391740.851974:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:2.0:1790391740.851990:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:2.0:1790391740.852004:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:2.0:1790391740.852023:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:2.0:1790391740.852038:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:2.0:1790391740.852051:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:2.0:1790391740.852066:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:2.0:1790391740.852081:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:2.0:1790391740.852096:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:2.0:1790391740.852112:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:2.0:1790391740.852547:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:2.0:1790391740.852569:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:2.0:1790391740.852585:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:2.0:1790391740.852600:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:2.0:1790391740.852689:0:23509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186551936:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790391740.853250:0:23509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391740.853373:0:23509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51810f90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391740.857089:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186551936 00000100:00100000:1.0:1790391740.857111:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186551936 00000100:00100000:1.0:1790391740.858220:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790391740.858237:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+15:23509:x1877361186551936:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790391740.858482:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+15:23509:x1877361186551936:12345-0@lo:502:mount.lustre.0 Request processed in 248us (5232us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391740.858491:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790391740.858907:0:23509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186551936:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790391740.859024:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:2.0:1790391740.859042:0:23509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1790391740.866437:0:23513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790391740.866458:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391740.866461:0:23513:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1790391740.866468:0:23513:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1790391740.866471:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790391740.866492:0:23513:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9e52ae8c99c0) 00000020:00000080:2.0:1790391740.866522:0:23513:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1790391740.866528:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1790391740.866627:0:23513:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790391740.866636:0:23513:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2b1b7949f13e2a37 00000020:00000080:2.0:1790391740.866951:0:23513:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1790391740.866975:0:23513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790391740.866979:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391740.866980:0:23513:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1790391740.866983:0:23513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790391740.866987:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391740.866989:0:23513:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1790391740.866992:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790391740.867001:0:23513:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9e52ae8ccd40) 00000020:00000080:2.0:1790391740.867014:0:23513:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1790391740.867019:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1790391740.867021:0:23513:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1790391740.867025:0:23513:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1790391740.867032:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790391740.867104:0:23513:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e5284985000 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1790391740.867118:0:23513:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9e52ae8cb380) 00000020:00000080:2.0:1790391740.867128:0:23513:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1790391740.867365:0:23513:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1790391740.867373:0:23513:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2b1b7949f13e2a4c 00000020:00000080:2.0:1790391740.867497:0:23513:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1790391740.867505:0:23513:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1790391740.867510:0:23513:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x2b1b7949f13e2a53 00080000:01000000:2.0:1790391740.867518:0:23513:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1790391740.867522:0:23513:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2b1b7949f13e2a5a 00010000:00010000:1.0:1790391741.004793:0:23513:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:0.0:1790391741.005564:0:23513:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:0.0:1790391741.006967:0:23513:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1790391741.007998:0:23513:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1790391741.008015:0:23513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790391741.008021:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391741.008024:0:23513:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1790391741.008027:0:23513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790391741.008034:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391741.008035:0:23513:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1790391741.008039:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790391741.008044:0:23513:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.128@tcp to nid 0x20000c0a8ca80 (192.168.202.128@tcp) 00000020:00000080:3.0:1790391741.008071:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790391741.008085:0:23513:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9e52b9d74d40) 00000020:00000080:3.0:1790391741.008105:0:23513:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1790391741.008109:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790391741.008182:0:23513:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1790391741.008189:0:23513:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1790391741.008196:0:23513:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2b1b7949f13e2a68 00010000:00080000:3.0:1790391741.008227:0:23513:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e51838d1800@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.128@tcp at head 00010000:00010000:3.0:1790391741.012270:0:23513:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1790391741.014691:0:23513:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1790391741.014707:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1790391741.014763:0:23513:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1790391741.014786:0:23513:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2b1b7949f13e2a6f 00000100:00080000:2.0:1790391741.014798:0:23513:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790391741.014804:0:23513:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9e51838d1800 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:2.0:1790391741.014841:0:23513:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e51820aca80 x1877361186552064/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790391741.014864:0:23513:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1790391741.014937:0:23513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790391741.014942:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391741.014944:0:23513:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1790391741.014947:0:23513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790391741.014950:0:23513:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1790391741.014952:0:23513:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790391741.014954:0:23513:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790391741.014955:0:23513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790391741.014958:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391741.014960:0:23513:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790391741.014962:0:23513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790391741.014967:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391741.014969:0:23513:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1790391741.014973:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1790391741.015005:0:23513:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1790391741.015020:0:23513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790391741.015023:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391741.015024:0:23513:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1790391741.015027:0:23513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790391741.015029:0:23513:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1790391741.015030:0:23513:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790391741.015032:0:23513:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790391741.015033:0:23513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790391741.015036:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391741.015038:0:23513:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790391741.015040:0:23513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790391741.015044:0:23513:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1790391741.015047:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391741.015049:0:23513:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1790391741.015052:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790391741.015055:0:23513:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.128@tcp to nid 0x20000c0a8ca80 (192.168.202.128@tcp) 00000020:01000000:2.0:1790391741.015078:0:23513:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1790391741.015080:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790391741.015097:0:23513:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9e52ae8c8000) 00000020:00000080:2.0:1790391741.015109:0:23513:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1790391741.015114:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790391741.015190:0:23513:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1790391741.015197:0:23513:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1790391741.015203:0:23513:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2b1b7949f13e2a7d 00010000:00080000:2.0:1790391741.015233:0:23513:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e52b75c1000@lustre-OST0000-osc-MDT0001: add connection 192.168.202.128@tcp at head 00010000:00010000:2.0:1790391741.015427:0:23513:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:2.0:1790391741.016213:0:23513:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1790391741.016410:0:23513:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1790391741.018144:0:23513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790391741.018563:0:23513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1790391741.018709:0:23513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:1.0:1790391741.019216:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186552064:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790391741.019293:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790391741.019362:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1790391741.019368:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1790391741.019371:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e52b5cfb000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790391741.019377:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 651 00000100:00080000:1.0:1790391741.019381:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1790391741.019387:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9e52b5cfb000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:1.0:1790391741.019434:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e518331e300 x1877361186552192/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790391741.019454:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790391741.019458:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790391741.019461:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790391741.019470:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790391741.019504:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186552192:0@lo:38:kworker.0 00000100:00100000:1.0:1790391741.019527:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391741.019552:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877361186552320:0@lo:400:kworker.0 00000100:00100000:1.0:1790391741.019576:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391741.019605:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186552064 00000100:00100000:1.0:1790391741.019611:0:22781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186552064 00000100:00100000:1.0:1790391741.019631:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186552192 00000100:00100000:1.0:1790391741.019633:0:22781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186552192 00000100:00100000:1.0:1790391741.019642:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790391741.019650:0:22781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518331f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1877361186552064:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1790391741.019672:0:22781:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 654 last 0 00000020:00000080:1.0:1790391741.019705:0:22781:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2b1b7949f13e2a84 00000004:00100000:1.0:1790391741.019718:0:22781:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1790391741.019724:0:22781:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:1.0:1790391741.019787:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186552320 00000100:00100000:1.0:1790391741.019791:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186552320 00000100:00100000:1.0:1790391741.019820:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790391741.019826:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518331f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877361186552320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391741.019866:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518331f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877361186552320:12345-0@lo:400:kworker.0 Request processed in 40us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391741.019873:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1790391741.019934:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e518331dc00 x1877361186552320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391741.019947:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877361186552320:0@lo:400:kworker.0 00000040:00080000:3.0:1790391741.021179:0:23518:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1790391741.021188:0:23518:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1790391741.022143:0:23513:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1790391741.022168:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790391741.022207:0:23513:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1790391741.022230:0:23513:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2b1b7949f13e2a8b 00000100:00080000:2.0:1790391741.022242:0:23513:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790391741.022249:0:23513:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9e52b75c1000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:2.0:1790391741.022286:0:23513:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e51820ace00 x1877361186552448/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790391741.022350:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186552448:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1790391741.022405:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877361186552448 offset 0 length 520: 4 00000100:00080000:2.0:1790391741.023168:0:23513:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1790391741.023255:0:23513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790391741.023262:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391741.023264:0:23513:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1790391741.023267:0:23513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790391741.023270:0:23513:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1790391741.023272:0:23513:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790391741.023273:0:23513:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790391741.023275:0:23513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790391741.023277:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391741.023295:0:23513:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790391741.023299:0:23513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790391741.023304:0:23513:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1790391741.023308:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391741.023309:0:23513:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1790391741.023312:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790391741.023316:0:23513:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.128@tcp to nid 0x20000c0a8ca80 (192.168.202.128@tcp) 00000020:01000000:2.0:1790391741.023341:0:23513:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1790391741.023344:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790391741.023372:0:23513:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9e52ae684d40) 00000020:00000080:2.0:1790391741.023391:0:23513:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1790391741.023398:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790391741.023499:0:23513:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1790391741.023506:0:23513:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1790391741.023513:0:23513:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2b1b7949f13e2a99 00010000:00080000:2.0:1790391741.023548:0:23513:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e52b5cbb800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.128@tcp at head 00010000:00010000:2.0:1790391741.023791:0:23513:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1790391741.023866:0:23513:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1790391741.023907:0:23513:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:0.0:1790391741.024992:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790391741.025000:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790391741.025003:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790391741.025006:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1790391741.027081:0:23513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790391741.030602:0:23513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1790391741.030843:0:23513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:1.0:1790391741.037284:0:23520:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1790391741.037292:0:23520:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1790391741.038073:0:23513:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1790391741.038087:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1790391741.038136:0:23513:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1790391741.038169:0:23513:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2b1b7949f13e2aa0 00000100:00080000:3.0:1790391741.038180:0:23513:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790391741.038187:0:23513:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e52b5cbb800 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:3.0:1790391741.038237:0:23513:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e52bb39b800 x1877361186552576/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790391741.038267:0:23513:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1790391741.038330:0:23513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790391741.038336:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391741.038338:0:23513:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1790391741.038341:0:23513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790391741.038345:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391741.038347:0:23513:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790391741.038350:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790391741.038352:0:23513:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1790391741.038354:0:23513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790391741.038357:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391741.038358:0:23513:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1790391741.038361:0:23513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790391741.038363:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391741.038365:0:23513:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1790391741.038368:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1790391741.038393:0:23513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790391741.038397:0:23513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391741.038399:0:23513:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1790391741.038402:0:23513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00100000:1.0:1790391741.038625:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb39b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186552576:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1790391741.038697:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877361186552576 offset 0 length 520: 4 00000020:01000000:1.0:1790391741.039005:0:23509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1790391741.039038:0:23509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1790391741.039062:0:23509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52bab9da00/0x2b1b7949f13e2a22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2a29 expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391741.039074:0:23509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e52bab9da00/0x2b1b7949f13e2a22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2a29 expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391741.039083:0:23509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e5284985000 from 1 10000000:01000000:1.0:1790391741.039085:0:23509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790391741.039116:0:23509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5184054a00/0x2b1b7949f13e2aa7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391741.039125:0:23509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e5184054a00/0x2b1b7949f13e2aa7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391741.039138:0:23509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e5184054a00/0x2b1b7949f13e2aa7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391741.039167:0:23509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186552704:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790391741.039210:0:23509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391741.039245:0:23509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52849e16c0 going to sleep for 11 seconds 00000100:00080000:1.0:1790391741.039446:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790391741.039451:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790391741.039454:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790391741.039457:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790391741.039653:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186552704 00000100:00100000:2.0:1790391741.039661:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186552704 00000100:00100000:2.0:1790391741.039711:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790391741.039720:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+15:23509:x1877361186552704:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790391741.039738:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391741.039750:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e518309c800/0x2b1b7949f13e2aae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e2aa7 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391741.039773:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e518309c800/0x2b1b7949f13e2aae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e2aa7 expref: 16 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391741.039792:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e518309c800/0x2b1b7949f13e2aae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2aa7 expref: 16 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391741.039802:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309c800, rc 0) 00000100:00100000:2.0:1790391741.039845:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+16:23509:x1877361186552704:12345-0@lo:101:mount.lustre.0 Request processed in 125us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391741.039851:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790391741.040137:0:23509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186552704:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790391741.040160:0:23509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e5184054a00/0x2b1b7949f13e2aa7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2aae expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391741.040169:0:23509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e5184054a00/0x2b1b7949f13e2aa7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e2aae expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391741.040704:0:23509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186552832:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1790391741.040761:0:23509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391741.040795:0:23509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52849e16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391741.041077:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186552832 00000100:00100000:2.0:1790391741.041084:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186552832 00000100:00100000:2.0:1790391741.041120:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790391741.041128:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+16:23509:x1877361186552832:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1790391741.041144:0:22769:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1790391741.041174:0:22769:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1790391741.041177:0:22769:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1790391741.041263:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+16:23509:x1877361186552832:12345-0@lo:256:mount.lustre.0 Request processed in 135us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391741.041270:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1790391741.041513:0:22781:0:(import.c:65:import_set_state_nolock()) ffff9e52b5cbe000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790391741.041605:0:22781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518331f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3636:x1877361186552064:12345-0@lo:38:llog_process_th.0 Request processed in 21954us (22310us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391741.041613:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790391741.041631:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790391741.041636:0:22781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518331fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1877361186552192:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1790391741.041673:0:22781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518331fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1877361186552192:12345-0@lo:38:kworker.0 Request processed in 36us (22145us total) trans 0 rc -11/-11 00000100:00100000:2.0:1790391741.041679:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790391741.041909:0:23509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186552832:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1790391741.042568:0:23509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790391741.042622:0:23509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5184054a00/0x2b1b7949f13e2aa7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2aae expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391741.042633:0:23509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5184054a00/0x2b1b7949f13e2aa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2aae expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391741.042744:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790391741.042754:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1790391741.042762:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1790391741.042767:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790391741.042770:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e51838d1800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790391741.042782:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186552064:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790391741.042816:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790391741.042821:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e52b5cfb000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790391741.042825:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1790391741.042828:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186552192:0@lo:38:kworker.0 00000100:00100000:1.0:1790391741.043050:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790391741.043064:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186552960:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790391741.043106:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391741.043157:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186552960 00000100:00100000:1.0:1790391741.043162:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186552960 00000100:00100000:1.0:1790391741.043199:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790391741.043208:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518331d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3637:x1877361186552960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790391741.043235:0:22782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1790391741.043274:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518331d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3637:x1877361186552960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391741.043281:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790391741.043312:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186552960:0@lo:41:osp-pre-0-1.0 10000000:01000000:0.0:1790391741.043989:0:23509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e5284985000 from 1 10000000:01000000:0.0:1790391741.043995:0:23509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790391741.044026:0:23509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295145c00/0x2b1b7949f13e2ab5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391741.044037:0:23509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e5295145c00/0x2b1b7949f13e2ab5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391741.044046:0:23509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e5295145c00/0x2b1b7949f13e2ab5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391741.044064:0:23509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186553088:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790391741.044099:0:23509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391741.044171:0:23509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a7685d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790391741.044352:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186553088 00000100:00100000:3.0:1790391741.044358:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186553088 00000100:00100000:3.0:1790391741.044436:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790391741.044445:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+16:23509:x1877361186553088:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790391741.044456:0:22770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391741.044470:0:22770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52bab9c800/0x2b1b7949f13e2abc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e2ab5 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391741.044492:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52bab9c800/0x2b1b7949f13e2abc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e2ab5 expref: 17 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391741.044503:0:22770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52bab9c800/0x2b1b7949f13e2abc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2ab5 expref: 17 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391741.044513:0:22770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52bab9c800, rc 0) 00000100:00100000:3.0:1790391741.044556:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+17:23509:x1877361186553088:12345-0@lo:101:mount.lustre.0 Request processed in 113us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391741.044563:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790391741.044626:0:23509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186553088:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790391741.044653:0:23509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e5295145c00/0x2b1b7949f13e2ab5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2abc expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391741.044662:0:23509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e5295145c00/0x2b1b7949f13e2ab5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e2abc expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790391741.048946:0:23509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:0.0:1790391741.049263:0:23509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790391741.049485:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1790391741.049511:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:0.0:1790391741.049526:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:0.0:1790391741.049537:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:0.0:1790391741.049548:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:0.0:1790391741.049559:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:0.0:1790391741.049570:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:0.0:1790391741.049581:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:0.0:1790391741.049592:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1790391741.049605:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:0.0:1790391741.049631:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:0.0:1790391741.049648:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:0.0:1790391741.049653:0:23509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:0.0:1790391741.049724:0:23509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186553216:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790391741.053634:0:23509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391741.053678:0:23509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a76850c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391741.054560:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186553216 00000100:00100000:2.0:1790391741.054572:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186553216 00000100:00100000:2.0:1790391741.054636:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790391741.054648:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+17:23509:x1877361186553216:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790391741.055067:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+17:23509:x1877361186553216:12345-0@lo:501:mount.lustre.0 Request processed in 420us (1440us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391741.055076:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790391741.055179:0:23509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186553216:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790391741.055230:0:23509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186553344:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790391741.055286:0:23509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391741.055322:0:23509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a76850c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391741.055400:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186553344 00000100:00100000:3.0:1790391741.055405:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186553344 00000100:00100000:3.0:1790391741.055508:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790391741.055518:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+17:23509:x1877361186553344:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790391741.055609:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+17:23509:x1877361186553344:12345-0@lo:503:mount.lustre.0 Request processed in 92us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391741.055622:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790391741.056654:0:23509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186553344:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790391741.057415:0:23509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790391741.058025:0:23509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186553472:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790391741.058105:0:23509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391741.058162:0:23509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a7685d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790391741.058528:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186553472 00000100:00100000:3.0:1790391741.058538:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186553472 00000100:00100000:3.0:1790391741.058598:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790391741.058608:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+17:23509:x1877361186553472:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790391741.058917:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+17:23509:x1877361186553472:12345-0@lo:502:mount.lustre.0 Request processed in 309us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391741.058924:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790391741.059673:0:23509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186553472:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790391741.060247:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1790391741.060284:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:0.0:1790391741.060301:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:0.0:1790391741.060318:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:0.0:1790391741.060333:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:0.0:1790391741.060348:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:0.0:1790391741.060361:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:0.0:1790391741.060374:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:0.0:1790391741.060389:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1790391741.060404:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:0.0:1790391741.060418:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:0.0:1790391741.060520:0:23509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186553600:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790391741.060595:0:23509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391741.060683:0:23509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a7685d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790391741.063806:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186553600 00000100:00100000:2.0:1790391741.063821:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186553600 00000100:00100000:2.0:1790391741.064118:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790391741.064131:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+17:23509:x1877361186553600:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790391741.064346:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+17:23509:x1877361186553600:12345-0@lo:502:mount.lustre.0 Request processed in 218us (3750us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391741.064355:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790391741.064593:0:23509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186553600:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790391741.064690:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:0.0:1790391741.064707:0:23509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1790391741.067815:0:23522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790391741.067830:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391741.067833:0:23522:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790391741.067842:0:23522:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e5284985000 00000020:00000080:0.0:1790391741.067845:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790391741.067852:0:23522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790391741.067870:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391741.067871:0:23522:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1790391741.067906:0:23522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790391741.067911:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391741.067912:0:23522:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790391741.067919:0:23522:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e5284985000 00000020:00000080:0.0:1790391741.067921:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790391741.067984:0:23522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790391741.067989:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391741.067990:0:23522:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1790391741.067993:0:23522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790391741.067995:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391741.067997:0:23522:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790391741.068000:0:23522:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e5284985000 00000020:00000080:0.0:1790391741.068002:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790391741.068038:0:23522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790391741.068041:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391741.068043:0:23522:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790391741.068046:0:23522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790391741.068048:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391741.068049:0:23522:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1790391741.068053:0:23522:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e5284985000 00000020:00000080:0.0:1790391741.068054:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790391741.068076:0:23522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790391741.068080:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391741.068081:0:23522:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1790391741.068085:0:23522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:1.0:1790391741.071448:0:23509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1790391741.071509:0:23509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790391741.071530:0:23509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295145c00/0x2b1b7949f13e2ab5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2abc expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391741.071543:0:23509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5295145c00/0x2b1b7949f13e2ab5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2abc expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391741.071609:0:23509:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1790391741.071612:0:23509:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e5284985000 10000000:01000000:1.0:1790391741.071616:0:23509:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e5284985000 10000000:01000000:1.0:1790391741.071620:0:23509:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790391741.071626:0:23509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e5284985000 from 1 10000000:01000000:1.0:1790391741.071629:0:23509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790391741.071670:0:23509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5184055000/0x2b1b7949f13e2ac3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391741.071678:0:23509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e5184055000/0x2b1b7949f13e2ac3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391741.071689:0:23509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e5184055000/0x2b1b7949f13e2ac3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391741.071720:0:23509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186553728:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790391741.071801:0:23509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391741.071839:0:23509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52849e1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391741.071865:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186553728 00000100:00100000:1.0:1790391741.071872:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186553728 00000100:00100000:1.0:1790391741.071930:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790391741.071939:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+17:23509:x1877361186553728:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790391741.071952:0:22770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391741.071964:0:22770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5184055200/0x2b1b7949f13e2aca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e2ac3 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391741.071987:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5184055200/0x2b1b7949f13e2aca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e2ac3 expref: 18 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391741.071998:0:22770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5184055200/0x2b1b7949f13e2aca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2ac3 expref: 18 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391741.072007:0:22770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5184055200, rc 0) 00000100:00100000:1.0:1790391741.072045:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+18:23509:x1877361186553728:12345-0@lo:101:mount.lustre.0 Request processed in 108us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391741.072051:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790391741.072101:0:23509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186553728:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790391741.072114:0:23509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e5184055000/0x2b1b7949f13e2ac3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2aca expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391741.072124:0:23509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e5184055000/0x2b1b7949f13e2ac3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e2aca expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790391741.076300:0:23509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:1.0:1790391741.092241:0:23509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790391741.092585:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:1.0:1790391741.092630:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:1.0:1790391741.092650:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:1.0:1790391741.092666:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:1.0:1790391741.092681:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:1.0:1790391741.092694:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:1.0:1790391741.092707:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:1.0:1790391741.092719:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:1.0:1790391741.092745:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:1.0:1790391741.092762:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:1.0:1790391741.092778:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:1.0:1790391741.092794:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:1.0:1790391741.092814:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:1.0:1790391741.092830:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:1.0:1790391741.092843:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:1.0:1790391741.092855:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:1.0:1790391741.092868:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:1.0:1790391741.092920:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:1.0:1790391741.092936:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:1.0:1790391741.092947:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:1.0:1790391741.092960:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:1.0:1790391741.092973:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:1.0:1790391741.092988:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:1.0:1790391741.093001:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:1.0:1790391741.093013:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:1.0:1790391741.093024:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:1.0:1790391741.093037:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:1.0:1790391741.093050:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:1.0:1790391741.093063:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:1.0:1790391741.093088:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:1.0:1790391741.093102:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:1.0:1790391741.093115:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:1.0:1790391741.093126:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:1.0:1790391741.093162:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:1.0:1790391741.093180:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:1.0:1790391741.093195:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:1.0:1790391741.093209:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:1.0:1790391741.093223:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:1.0:1790391741.093237:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:1.0:1790391741.093251:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:1.0:1790391741.093264:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:1.0:1790391741.093279:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:1.0:1790391741.093293:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:1.0:1790391741.093308:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:1.0:1790391741.093322:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:1.0:1790391741.093335:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:1.0:1790391741.093348:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:1.0:1790391741.093359:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:1.0:1790391741.093491:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:1.0:1790391741.093509:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:1.0:1790391741.093525:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:1.0:1790391741.093531:0:23509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:1.0:1790391741.093648:0:23509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186553856:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790391741.093721:0:23509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391741.093776:0:23509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52849e19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391741.093808:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186553856 00000100:00100000:1.0:1790391741.093815:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186553856 00000100:00100000:1.0:1790391741.093859:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790391741.093869:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+18:23509:x1877361186553856:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790391741.094006:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+18:23509:x1877361186553856:12345-0@lo:501:mount.lustre.0 Request processed in 138us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391741.094020:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790391741.094069:0:23509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186553856:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790391741.094100:0:23509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186553984:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790391741.094138:0:23509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391741.094175:0:23509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52849e19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391741.101227:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186553984 00000100:00100000:2.0:1790391741.101245:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186553984 00000100:00100000:2.0:1790391741.101312:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790391741.101323:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+18:23509:x1877361186553984:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790391741.101840:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+18:23509:x1877361186553984:12345-0@lo:503:mount.lustre.0 Request processed in 518us (7700us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391741.101849:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790391741.102029:0:23509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186553984:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790391741.102990:0:23509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790391741.103076:0:23509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186554112:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790391741.103144:0:23509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391741.103190:0:23509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a76380c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391741.103279:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186554112 00000100:00100000:2.0:1790391741.103287:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186554112 00000100:00100000:2.0:1790391741.103333:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790391741.103341:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+18:23509:x1877361186554112:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790391741.103555:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+18:23509:x1877361186554112:12345-0@lo:502:mount.lustre.0 Request processed in 214us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391741.103570:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790391741.103838:0:23509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186554112:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790391741.104057:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:0.0:1790391741.104083:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:0.0:1790391741.104095:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:0.0:1790391741.104107:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:0.0:1790391741.104117:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:0.0:1790391741.104127:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:0.0:1790391741.104138:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:0.0:1790391741.104176:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:0.0:1790391741.104190:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:0.0:1790391741.104202:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:0.0:1790391741.104213:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:0.0:1790391741.104224:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:0.0:1790391741.104235:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:0.0:1790391741.104246:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:0.0:1790391741.104256:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:0.0:1790391741.104266:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:0.0:1790391741.104277:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:0.0:1790391741.104288:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:0.0:1790391741.104299:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:0.0:1790391741.104310:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:0.0:1790391741.104321:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:0.0:1790391741.104332:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:0.0:1790391741.104343:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:0.0:1790391741.104366:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:0.0:1790391741.104380:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:0.0:1790391741.104406:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:0.0:1790391741.104421:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:0.0:1790391741.106260:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:0.0:1790391741.106298:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:0.0:1790391741.106313:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:0.0:1790391741.106325:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:0.0:1790391741.106352:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:0.0:1790391741.106365:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:0.0:1790391741.106378:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:0.0:1790391741.106390:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:0.0:1790391741.106403:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:0.0:1790391741.106416:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:0.0:1790391741.107647:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:0.0:1790391741.107722:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:0.0:1790391741.107835:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:0.0:1790391741.107853:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:0.0:1790391741.107866:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:0.0:1790391741.107907:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:0.0:1790391741.107924:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:0.0:1790391741.107938:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:0.0:1790391741.107950:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:0.0:1790391741.107964:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:0.0:1790391741.107979:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:0.0:1790391741.108054:0:23509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186554240:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790391741.108142:0:23509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391741.108202:0:23509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a76380c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391741.108283:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186554240 00000100:00100000:2.0:1790391741.108290:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186554240 00000100:00100000:2.0:1790391741.108346:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790391741.108356:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+18:23509:x1877361186554240:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790391741.108482:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+18:23509:x1877361186554240:12345-0@lo:502:mount.lustre.0 Request processed in 126us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391741.108489:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790391741.108637:0:23509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186554240:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790391741.108851:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:0.0:1790391741.108874:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:0.0:1790391741.108919:0:23509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186554368:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790391741.108957:0:23509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391741.108977:0:23509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a76380c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391741.108999:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186554368 00000100:00100000:0.0:1790391741.109003:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186554368 00000100:00100000:0.0:1790391741.109038:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790391741.109045:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+18:23509:x1877361186554368:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790391741.109122:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+18:23509:x1877361186554368:12345-0@lo:502:mount.lustre.0 Request processed in 76us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391741.109129:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790391741.111643:0:23509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186554368:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790391741.111767:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:2.0:1790391741.111784:0:23509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1790391741.112735:0:23527:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1790391741.112758:0:23527:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9e52ae6819c0) 00000020:00000080:2.0:1790391741.112784:0:23527:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1790391741.112871:0:23527:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e5284985000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1790391741.112972:0:23527:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e5284985000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1790391741.112977:0:23527:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e5284985000 3 00010000:00080000:2.0:1790391741.113083:0:23527:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e52afeee800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.128@tcp at head 00010000:00010000:3.0:1790391741.117971:0:23527:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1790391741.118188:0:23527:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1790391741.118241:0:23527:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790391741.118256:0:23527:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x2b1b7949f13e2ad8 00000100:00080000:3.0:1790391741.118267:0:23527:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790391741.118274:0:23527:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9e52afeee800 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:3.0:1790391741.118315:0:23527:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e52bb39bb80 x1877361186554496/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790391741.118352:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb39bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1877361186554496:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790391741.118431:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391741.118502:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186554496 00000100:00100000:3.0:1790391741.118509:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186554496 00000100:00100000:3.0:1790391741.118540:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790391741.118547:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bb399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1877361186554496:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1790391741.118570:0:22777:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 654 last 0 00000020:00000080:3.0:1790391741.118603:0:22777:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x2b1b7949f13e2adf 00000004:00100000:3.0:1790391741.118617:0:22777:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790391741.118653:0:22777:0:(import.c:65:import_set_state_nolock()) ffff9e52b5cfe800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790391741.118714:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bb399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1877361186554496:12345-0@lo:38:llog_process_th.0 Request processed in 165us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391741.118722:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1790391741.118742:0:23527:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790391741.118764:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790391741.118769:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790391741.118772:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790391741.118775:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:2.0:1790391741.118923:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e52bb39bb80 x1877361186554496/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790391751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391741.118935:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790391741.118942:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1790391741.118950:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1790391741.118953:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790391741.118956:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e52afeee800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790391741.118961:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb39bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1877361186554496:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1790391741.121555:0:23527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:0.0:1790391741.123013:0:23509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1790391741.123055:0:23509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790391741.123075:0:23509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5184055000/0x2b1b7949f13e2ac3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2aca expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391741.123089:0:23509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5184055000/0x2b1b7949f13e2ac3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2aca expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790391741.123163:0:23509:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790391741.123166:0:23509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1790391741.123167:0:23509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790391741.123168:0:23509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790391741.123170:0:23509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790391741.123171:0:23509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790391741.123172:0:23509:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790391741.123174:0:23509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790391741.123175:0:23509:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790391741.123180:0:23509:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1790391741.123182:0:23509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790391741.123183:0:23509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1790391741.123184:0:23509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790391741.123185:0:23509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790391741.123186:0:23509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790391741.123187:0:23509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790391741.123188:0:23509:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790391741.123189:0:23509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790391741.123190:0:23509:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790391741.123218:0:23509:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1790391741.123243:0:23509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186554624:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790391741.123320:0:23509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391741.123367:0:23509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a7638000 going to sleep for 11 seconds 00000100:00100000:2.0:1790391741.124974:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186554624 00000100:00100000:2.0:1790391741.125061:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186554624 00000100:00100000:2.0:1790391741.125119:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790391741.125130:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7674050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+18:23509:x1877361186554624:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790391741.125179:0:22771:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1790391741.125194:0:22771:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1790391741.128048:0:22756:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1790391741.128107:0:22771:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790391741.128127:0:22771:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1790391741.128411:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7674050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+18:23509:x1877361186554624:12345-0@lo:253:mount.lustre.0 Request processed in 3277us (5084us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391741.128428:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 20000000:01000000:0.0:1790391741.129566:0:22792:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790391741.129573:0:22792:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790391741.129599:0:22792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e5295144000/0x2b1b7949f13e2ae6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391741.129616:0:22792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5184054000/0x2b1b7949f13e29ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e29e3 expref: 17 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391741.129624:0:22792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e518309c800/0x2b1b7949f13e2aae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2aa7 expref: 17 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391741.129632:0:22792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e5295144000/0x2b1b7949f13e2ae6 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391741.129670:0:22792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e518309c800/0x2b1b7949f13e2aae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e2aa7 expref: 17 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391741.129687:0:22792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e518309c800/0x2b1b7949f13e2aae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e2aa7 expref: 17 pid: 22771 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391741.129702:0:22792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f6300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22792:1877361186554752:0@lo:104: 00000100:00100000:0.0:1790391741.129767:0:22792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790391741.129816:0:22792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5184054000/0x2b1b7949f13e29ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e29e3 expref: 17 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391741.129824:0:22792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e5184054000/0x2b1b7949f13e29ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e29e3 expref: 17 pid: 22771 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391741.129832:0:22792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f5500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22792:1877361186554880:0@lo:104: 00000100:00100000:0.0:1790391741.129863:0:22792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391741.129911:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a7638480 going to sleep for 11 seconds 00000100:00100000:0.0:1790391741.129942:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186554752 00000100:00100000:0.0:1790391741.129951:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186554752 00000100:00100000:0.0:1790391741.129987:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186554880 00000100:00100000:0.0:1790391741.129990:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186554880 00000100:00100000:0.0:1790391741.130005:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790391741.130013:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e907dcd1-fffe-43bb-853f-376b925bb229+4:22792:x1877361186554752:12345-0@lo:104: 00010000:00010000:0.0:1790391741.130026:0:22759:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e5184054a00/0x2b1b7949f13e2aa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e2aae expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391741.130070:0:22759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790391741.130076:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e907dcd1-fffe-43bb-853f-376b925bb229+4:22792:x1877361186554752:12345-0@lo:104: Request processed in 64us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391741.130084:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790391741.130098:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790391741.130104:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e907dcd1-fffe-43bb-853f-376b925bb229+3:22792:x1877361186554880:12345-0@lo:104: 00010000:00010000:0.0:1790391741.130111:0:22759:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e518309d600/0x2b1b7949f13e29e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e29ea expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391741.130137:0:22759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790391741.130142:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e907dcd1-fffe-43bb-853f-376b925bb229+3:22792:x1877361186554880:12345-0@lo:104: Request processed in 39us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391741.130159:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1790391741.130176:0:22764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790391741.130182:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e5184054a00/0x2b1b7949f13e2aa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e2aae expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391741.130189:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5184054a00 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:0.0:1790391741.130200:0:22764:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e5184054a00/0x2b1b7949f13e2aa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e2aae expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391741.130209:0:22764:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5184054a00/0x2b1b7949f13e2aa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e2aae expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790391741.130216:0:22764:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5184054a00/0x2b1b7949f13e2aa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e2aae expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391741.130221:0:22764:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790391741.130252:0:22764:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e5184054a00/0x2b1b7949f13e2aa7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e2aae expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391741.130258:0:22764:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790391741.130278:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e5184054a00/0x2b1b7949f13e2aa7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e2aae expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391741.130285:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5184054a00/0x2b1b7949f13e2aa7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e2aae expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391741.130296:0:22764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391741.130300:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e518309d600/0x2b1b7949f13e29e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e29ea expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391741.130305:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309d600 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:0.0:1790391741.130308:0:22764:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e518309d600/0x2b1b7949f13e29e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e29ea expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391741.130315:0:22764:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e518309d600/0x2b1b7949f13e29e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e29ea expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790391741.130330:0:22764:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e518309d600/0x2b1b7949f13e29e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e29ea expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391741.130335:0:22764:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790391741.130348:0:22764:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e518309d600/0x2b1b7949f13e29e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e29ea expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391741.130354:0:22764:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790391741.130360:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e518309d600/0x2b1b7949f13e29e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e29ea expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391741.130367:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e518309d600/0x2b1b7949f13e29e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e29ea expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391741.130380:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391741.130382:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391741.130384:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391741.130391:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391741.130402:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e907dcd1-fffe-43bb-853f-376b925bb229:3639:1877361186555008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790391741.130431:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391741.130448:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790391741.130453:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e907dcd1-fffe-43bb-853f-376b925bb229:3639:1877361186555136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790391741.130469:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391741.130528:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186555008 00000100:00100000:0.0:1790391741.130533:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186555008 00010000:00010000:0.0:1790391741.130551:0:22762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e518309c800/0x2b1b7949f13e2aae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e2aa7 expref: 18 pid: 22771 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391741.130570:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186555136 00000100:00100000:0.0:1790391741.130577:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186555136 00010000:00010000:0.0:1790391741.130589:0:22762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5184054000/0x2b1b7949f13e29ea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e29e3 expref: 19 pid: 22771 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391741.130601:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790391741.130607:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e907dcd1-fffe-43bb-853f-376b925bb229+19:3639:x1877361186555008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790391741.130618:0:22762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391741.130622:0:22762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e518309c800/0x2b1b7949f13e2aae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e2aa7 expref: 19 pid: 22771 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391741.130632:0:22762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e518309c800/0x2b1b7949f13e2aae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e2aa7 expref: 19 pid: 22771 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391741.130645:0:22762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391741.130669:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e907dcd1-fffe-43bb-853f-376b925bb229+19:3639:x1877361186555008:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391741.130675:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790391741.130686:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790391741.130692:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e907dcd1-fffe-43bb-853f-376b925bb229+18:3639:x1877361186555136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790391741.130698:0:22762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391741.130702:0:22762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5184054000/0x2b1b7949f13e29ea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e29e3 expref: 18 pid: 22771 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391741.130710:0:22762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5184054000/0x2b1b7949f13e29ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e29e3 expref: 18 pid: 22771 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391741.130721:0:22762:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e5295144000/0x2b1b7949f13e2ae6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391741.130728:0:22762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5295144000/0x2b1b7949f13e2ae6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790391741.130746:0:22762:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013940840s 00010000:00010000:0.0:1790391741.130751:0:22762:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e5295144000/0x2b1b7949f13e2ae6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391741.130757:0:22762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e5295144000/0x2b1b7949f13e2ae6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391741.130764:0:22762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e5295144000/0x2b1b7949f13e2ae6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391741.130771:0:22762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e5295144000/0x2b1b7949f13e2ae6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391741.130776:0:22762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295144000 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:0.0:1790391741.130781:0:22762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e5295144000/0x2b1b7949f13e2ae6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391741.130790:0:22762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e5295144000/0x2b1b7949f13e2ae6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391741.130798:0:22762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e5295144000/0x2b1b7949f13e2ae6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391741.130808:0:22762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391741.130829:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e907dcd1-fffe-43bb-853f-376b925bb229+18:3639:x1877361186555136:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391741.130835:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790391741.130844:0:22817:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e99b300 going to sleep for 0 seconds 00000100:00100000:0.0:1790391741.130929:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e907dcd1-fffe-43bb-853f-376b925bb229:3639:1877361186555136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790391741.130937:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e907dcd1-fffe-43bb-853f-376b925bb229:3639:1877361186555008:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790391741.130980:0:22792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e518309c800/0x2b1b7949f13e2aae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e2aa7 expref: 17 pid: 22771 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391741.130990:0:22792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f6300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22792:1877361186554752:0@lo:104: 00010000:00010000:0.0:1790391741.130999:0:22792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5184054000/0x2b1b7949f13e29ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e29e3 expref: 16 pid: 22771 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391741.131006:0:22792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f5500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22792:1877361186554880:0@lo:104: 00010000:00010000:0.0:1790391741.131017:0:22792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e5295144000/0x2b1b7949f13e2ae6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391741.131025:0:22792:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e5295144000/0x2b1b7949f13e2ae6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391741.131032:0:22792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e5295144000/0x2b1b7949f13e2ae6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391741.131038:0:22792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5295144000/0x2b1b7949f13e2ae6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391741.131090:0:23509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:23509:1877361186554624:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790391741.131101:0:23509:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1790391741.131104:0:23509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790391741.131105:0:23509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1790391741.131107:0:23509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790391741.131108:0:23509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790391741.131109:0:23509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790391741.131110:0:23509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790391741.131112:0:23509:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790391741.131114:0:23509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790391741.131115:0:23509:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790391741.131126:0:23509:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000040:01000000:0.0:1790391741.145194:0:23509:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1790391741.145422:0:23533:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1790391741.145435:0:23533:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1790391741.145905:0:23534:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1790391741.146290:0:23509:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:0.0:1790391741.146646:0:23534:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790391741.148723:0:23534:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1790391741.148816:0:23534:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:2.0:1790391741.159649:0:23535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820aca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23535:1877361186555264:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1790391741.159804:0:23535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391741.159843:0:23535:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b5f9ab40 going to sleep for 11 seconds 00000040:01000000:3.0:1790391741.160081:0:23509:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:1.0:1790391741.160086:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186555264 00000100:00100000:1.0:1790391741.160094:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186555264 00000040:00080000:3.0:1790391741.160123:0:23509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790391741.160165:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790391741.160175:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23535:x1877361186555264:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1790391741.160253:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23535:x1877361186555264:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 80us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391741.160260:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790391741.160334:0:23535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820aca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23535:1877361186555264:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1790391741.160361:0:23535:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1790391741.160385:0:23535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820aca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23535:1877361186555392:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1790391741.160412:0:23535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391741.160432:0:23535:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b5f9aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1790391741.160468:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186555392 00000100:00100000:1.0:1790391741.160472:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186555392 00000100:00100000:1.0:1790391741.160500:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790391741.160508:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23535:x1877361186555392:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1790391741.160595:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23535:x1877361186555392:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 89us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391741.160601:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790391741.160734:0:23535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820aca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23535:1877361186555392:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1790391741.160785:0:23535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820aca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23535:1877361186555520:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1790391741.160810:0:23535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000080:3.0:1790391741.161461:0:23509:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000100:00100000:3.0:1790391741.161496:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186555520 00000100:00100000:3.0:1790391741.161501:0:22787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186555520 00000100:00100000:3.0:1790391741.161535:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790391741.161542:0:22787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23535:x1877361186555520:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1790391741.165974:0:22787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23535:x1877361186555520:12345-0@lo:900:lod0001_rec0000.0 Request processed in 4417us (5147us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391741.165991:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:01000000:3.0:1790391741.166046:0:23509:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1790391741.166163:0:23509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790391741.167415:0:23509:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1790391741.168324:0:23509:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1790391741.168361:0:23509:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000100:00100000:2.0:1790391741.169605:0:23535:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b5f9ab40 going to sleep for 11 seconds 00010000:00080000:2.0:1790391741.169648:0:23535:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e51820aca80 x1877361186555520/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790391757 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391741.169664:0:23535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820aca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23535:1877361186555520:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1790391741.169755:0:23535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820aca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23535:1877361186555648:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1790391741.169816:0:23535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391741.169859:0:23535:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b5f9aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1790391741.170023:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186555648 00000100:00100000:1.0:1790391741.170030:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186555648 00000040:00080000:3.0:1790391741.170035:0:23509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790391741.170080:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790391741.170089:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23535:x1877361186555648:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1790391741.170178:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23535:x1877361186555648:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 89us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391741.170200:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790391741.170857:0:23535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820aca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23535:1877361186555648:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1790391741.170924:0:23535:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790391741.174091:0:23535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1790391741.174169:0:23535:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1790391741.174184:0:23535:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00080000:10000000:3.0:1790391741.180710:0:23509:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000001:00000004:3.0:1790391741.183398:0:23509:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:3.0:1790391741.187206:0:23509:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1790391741.187246:0:23509:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffab8400e2b988 00100000:10000000:3.0:1790391741.187255:0:23509:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1790391741.187724:0:23509:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790391741.187772:0:23509:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.128@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790391741.187792:0:23509:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1790391741.187811:0:23509:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1790391741.188502:0:23509:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790391741.188719:0:23509:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790391741.259027:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391742.152819:0:22817:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e99b300 going to sleep for 0 seconds 00000040:00080000:2.0:1790391742.159851:0:23532:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790391742.284712:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790391743.112477:0:22773:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790391743.112486:0:22773:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e5284985000 from 12 10000000:01000000:3.0:1790391743.112493:0:22773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790391743.112548:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d400/0x2b1b7949f13e2aed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391743.112560:0:22773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d400/0x2b1b7949f13e2aed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391743.112572:0:22773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d400/0x2b1b7949f13e2aed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391743.112600:0:22773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb39aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186555776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790391743.112672:0:22773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391743.112718:0:22773:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528820d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391743.112769:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186555776 00000100:00100000:0.0:1790391743.112778:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186555776 00000100:00100000:0.0:1790391743.112835:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790391743.112846:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+16:22773:x1877361186555776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790391743.112861:0:22769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391743.112904:0:22769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5295144200/0x2b1b7949f13e2af4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e2aed expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391743.112930:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5295144200/0x2b1b7949f13e2af4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e2aed expref: 17 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391743.112942:0:22769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5295144200/0x2b1b7949f13e2af4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2aed expref: 17 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391743.112952:0:22769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5295144200, rc 0) 00000100:00100000:0.0:1790391743.112996:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+17:22773:x1877361186555776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391743.113003:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790391743.113525:0:22773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb39aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186555776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391743.113541:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d400/0x2b1b7949f13e2aed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2af4 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391743.113550:0:22773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d400/0x2b1b7949f13e2aed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e2af4 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391743.113611:0:22773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb39aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186555904:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1790391743.113646:0:22773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391743.113669:0:22773:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528820d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391743.115800:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186555904 00000100:00100000:0.0:1790391743.115817:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186555904 00000100:00100000:0.0:1790391743.115902:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790391743.115914:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7674850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+17:22773:x1877361186555904:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1790391743.115939:0:22771:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790391743.115958:0:22771:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790391743.115961:0:22771:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1790391743.116094:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7674850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+17:22773:x1877361186555904:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 182us (2446us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391743.116102:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790391743.116169:0:22773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb39aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186555904:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1790391743.116225:0:22773:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790391743.116235:0:22773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d400/0x2b1b7949f13e2aed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2af4 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391743.116245:0:22773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d400/0x2b1b7949f13e2aed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2af4 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391743.116255:0:22773:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790391743.116257:0:22773:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e52b56dd000 from 12 10000000:01000000:0.0:1790391743.116260:0:22773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790391743.116289:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e2afb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391743.116297:0:22773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e2afb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391743.116305:0:22773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e2afb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391743.116325:0:22773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186556032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790391743.116355:0:22773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391743.116385:0:22773:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5182200780 going to sleep for 11 seconds 00000100:00100000:0.0:1790391743.116398:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186556032 00000100:00100000:0.0:1790391743.116402:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186556032 00000100:00100000:0.0:1790391743.116426:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790391743.116432:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+17:22773:x1877361186556032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790391743.116440:0:22770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391743.116452:0:22770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5295145200/0x2b1b7949f13e2b02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e2afb expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391743.116478:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5295145200/0x2b1b7949f13e2b02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e2afb expref: 18 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391743.116488:0:22770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5295145200/0x2b1b7949f13e2b02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2afb expref: 18 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391743.116497:0:22770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5295145200, rc 0) 00000100:00100000:0.0:1790391743.116528:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+18:22773:x1877361186556032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391743.116533:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790391743.116560:0:22773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186556032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790391743.116571:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e2afb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2b02 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391743.116579:0:22773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e2afb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e2b02 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391743.116618:0:22773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186556160:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790391743.116644:0:22773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391743.116657:0:22773:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5182200780 going to sleep for 11 seconds 00000100:00100000:0.0:1790391743.116668:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186556160 00000100:00100000:0.0:1790391743.116671:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186556160 00000100:00100000:0.0:1790391743.116688:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790391743.116694:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+18:22773:x1877361186556160:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1790391743.116703:0:22770:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790391743.116714:0:22770:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790391743.116720:0:22770:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1790391743.116779:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+18:22773:x1877361186556160:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 84us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391743.116786:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790391743.116815:0:22773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186556160:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1790391743.116843:0:22773:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790391743.116848:0:22773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e2afb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2b02 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391743.116855:0:22773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e2afb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2b02 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391743.177235:0:22817:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e99b300 going to sleep for 0 seconds 00000040:00080000:3.0:1790391743.177640:0:23532:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790391743.303972:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790391744.077533:0:22810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790391744.200327:0:22817:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e99b300 going to sleep for 0 seconds 00010000:00010000:1.0:1790391744.335151:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391745.230625:0:22817:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e99b300 going to sleep for 0 seconds 00010000:00010000:2.0:1790391745.353278:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391746.056630:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186556288:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790391746.056716:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391746.057488:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186556288 00000100:00100000:2.0:1790391746.057510:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186556288 00000100:00100000:2.0:1790391746.057813:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790391746.057823:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186556288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790391746.057864:0:22782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1790391746.057955:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186556288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 133us (1239us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391746.057962:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790391746.058010:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186556288:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790391746.249111:0:22817:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e99b300 going to sleep for 0 seconds 00010000:00010000:1.0:1790391746.376124:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790391746.519130:0:23779:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg228-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:0.0:1790391746.579120:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1790391746.579127:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1790391746.579130:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e52b5cfb000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790391746.579142:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9e52b5cfb000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:0.0:1790391746.579165:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e51838f6680 x1877361186556544/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790391746.579184:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790391746.579187:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790391746.579189:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790391746.579192:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790391746.579207:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790391746.579220:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790391746.579223:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790391746.579225:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790391746.579277:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186556544:0@lo:38:kworker.0 00000100:00100000:0.0:1790391746.579348:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391746.579399:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877361186556672:0@lo:400:kworker.0 00000100:00100000:0.0:1790391746.579428:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391746.579456:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790391746.579461:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877361186556800:0@lo:400:kworker.0 00000100:00100000:0.0:1790391746.579486:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391746.579610:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e907dcd1-fffe-43bb-853f-376b925bb229:3638:1877361186556416:0@lo:400:kworker.0 00000100:00100000:2.0:1790391746.579708:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391746.579749:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186556544 00000100:00100000:2.0:1790391746.579756:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186556544 00000100:00100000:2.0:1790391746.579787:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790391746.579794:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1877361186556544:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1790391746.579819:0:22782:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 659 last 0 00000020:00000080:2.0:1790391746.579853:0:22782:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2b1b7949f13e2b09 00000004:00100000:2.0:1790391746.579867:0:22782:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1790391746.579873:0:22782:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:1.0:1790391746.580033:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186556672 00000100:00100000:1.0:1790391746.580039:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186556672 00000100:00100000:1.0:1790391746.580073:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186556800 00000100:00100000:1.0:1790391746.580076:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186556800 00000100:00100000:1.0:1790391746.580090:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790391746.580096:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877361186556672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391746.580159:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877361186556672:12345-0@lo:400:kworker.0 Request processed in 63us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391746.580165:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790391746.580178:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790391746.580183:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877361186556800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391746.580206:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877361186556800:12345-0@lo:400:kworker.0 Request processed in 23us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391746.580211:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790391746.580612:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186556416 00000100:00100000:0.0:1790391746.580617:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186556416 00000100:00100000:0.0:1790391746.580747:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790391746.580756:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+18:3638:x1877361186556416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391746.580806:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+18:3638:x1877361186556416:12345-0@lo:400:kworker.0 Request processed in 52us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391746.580812:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1790391746.580857:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e51838f4700 x1877361186556800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391746.580872:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877361186556800:0@lo:400:kworker.0 00010000:00080000:0.0:1790391746.580905:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e51838f7480 x1877361186556672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391746.580913:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877361186556672:0@lo:400:kworker.0 00000100:00100000:2.0:1790391746.581825:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e907dcd1-fffe-43bb-853f-376b925bb229:3638:1877361186556416:0@lo:400:kworker.0 00000100:00080000:2.0:1790391746.586077:0:22782:0:(import.c:65:import_set_state_nolock()) ffff9e52afee8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790391746.586190:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3636:x1877361186556544:12345-0@lo:38:kworker.0 Request processed in 6394us (6840us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391746.586201:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1790391746.586311:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1790391746.586321:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1790391746.586326:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1790391746.586328:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e52b5cfb000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1790391746.586341:0:3636:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000c403450a): req@ffff9e51838f7100 x1877361186549120/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391746.586371:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186556544:0@lo:38:kworker.0 00000100:00100000:1.0:1790391746.586436:0:22817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391746.586457:0:22817:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e99b300 going to sleep for 11 seconds 00000100:00100000:2.0:1790391746.586592:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186549120 00000100:00100000:2.0:1790391746.586599:0:22781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186549120 00000100:00100000:2.0:1790391746.586640:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790391746.586650:0:22781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518331df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22817:x1877361186549120:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1790391746.586740:0:22781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518331df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22817:x1877361186549120:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 91us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391746.586747:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790391746.586776:0:22817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f7100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22817:1877361186549120:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1790391746.586809:0:22817:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1790391746.586849:0:22817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820aea00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22817:1877361186556928:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1790391746.586905:0:22817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391746.586928:0:22817:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b5f9a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391746.586938:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186556928 00000100:00100000:2.0:1790391746.586941:0:22781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186556928 00000100:00100000:2.0:1790391746.586959:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790391746.586965:0:22781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22817:x1877361186556928:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1790391746.587052:0:22781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22817:x1877361186556928:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 87us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391746.587058:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790391746.587082:0:22817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820aea00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22817:1877361186556928:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1790391746.587154:0:22817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820aea00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22817:1877361186557056:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1790391746.587178:0:22817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391746.587191:0:22817:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e99b300 going to sleep for 11 seconds 00000100:00100000:2.0:1790391746.587202:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186557056 00000100:00100000:2.0:1790391746.587205:0:22781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186557056 00000100:00100000:2.0:1790391746.587222:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790391746.587228:0:22781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22817:x1877361186557056:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1790391746.587289:0:22781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22817:x1877361186557056:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 61us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391746.587305:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790391746.587330:0:22817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820aea00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22817:1877361186557056:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1790391746.587367:0:22817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790391746.589389:0:22817:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1790391746.589473:0:22817:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 24, retries 0 00000004:00080000:2.0:1790391746.589479:0:22817:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:0.0:1790391746.592208:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186557184:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790391746.592283:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391746.592347:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186557184 00000100:00100000:0.0:1790391746.592356:0:22781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186557184 00000100:00100000:0.0:1790391746.592410:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790391746.592419:0:22781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1877361186557184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790391746.592456:0:22781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790391746.592502:0:22781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1877361186557184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391746.592509:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790391746.592566:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186557184:0@lo:41:osp-pre-1-0.0 00000020:00000004:3.0:1790391747.386308:0:23831:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790391747.386514:0:23831:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790391747.400041:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391747.594003:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790391732/real 1790391732] req@ffff9e518331f800 x1877361186550144/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391747 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391747.594034:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e518331f800 x1877361186550144/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391747 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391747.594044:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790391732/real 1790391732] req@ffff9e518331ca80 x1877361186550272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391747 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391747.594054:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e518331ca80 x1877361186550272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391747 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790391747.594073:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e528493f000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790391747.594102:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1790391747.594106:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186550144:0@lo:8:kworker.0 00000100:00080000:1.0:1790391747.594112:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e528493c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790391747.594117:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1790391747.594120:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186550272:0@lo:8:kworker.0 00000100:00080000:2.0:1790391747.594245:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790391747.594249:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1790391747.594252:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e528493f000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790391747.594258:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 646 00000100:00080000:2.0:1790391747.594263:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790391747.594269:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e528493f000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:3.0:1790391747.594271:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e907dcd1-fffe-43bb-853f-376b925bb229:3638:1877361186557312:0@lo:400:kworker.0 00000100:00100000:2.0:1790391747.594290:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e51820ac700 x1877361186557568/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790391747.594303:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790391747.594305:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790391747.594307:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e528493c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790391747.594310:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 646 00000100:00080000:2.0:1790391747.594311:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790391747.594314:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e528493c000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:2.0:1790391747.594324:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e51820af800 x1877361186557696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790391747.594338:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790391747.594345:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790391747.594355:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790391747.594358:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790391747.594360:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790391747.594378:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877361186558080:0@lo:400:kworker.0 00000100:00100000:2.0:1790391747.594383:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186557440:0@lo:400:kworker.0 00000100:00100000:3.0:1790391747.594404:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391747.594411:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391747.594424:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790391747.594428:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790391747.594429:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186557952:0@lo:400:kworker.0 00000100:00100000:2.0:1790391747.594432:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877361186557824:0@lo:400:kworker.0 00000100:00100000:3.0:1790391747.594449:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391747.594453:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391747.594478:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186557312 00000100:00100000:2.0:1790391747.594478:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186557440 00000100:00100000:3.0:1790391747.594485:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186557312 00000100:00100000:2.0:1790391747.594485:0:22781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186557440 00000100:00100000:2.0:1790391747.594517:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186557952 00000100:00100000:2.0:1790391747.594519:0:22781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186557952 00000100:00100000:3.0:1790391747.594526:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790391747.594530:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790391747.594533:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7676450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+18:3638:x1877361186557312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391747.594535:0:22781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1877361186557440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391747.602086:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186558080 00000100:00100000:0.0:1790391747.602114:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186558080 00000100:00100000:0.0:1790391747.602177:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186557824 00000100:00100000:0.0:1790391747.602181:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186557824 00000100:00100000:0.0:1790391747.602202:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790391747.602213:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bb398e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877361186558080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391747.602285:0:22778:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1790391747.602305:0:22778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1790391747.604506:0:22781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1877361186557440:12345-0@lo:400:kworker.0 Request processed in 9958us (10081us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391747.604524:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790391747.605458:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186557440:0@lo:400:kworker.0 00000100:00100000:2.0:1790391747.606433:0:22777:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1790391747.606453:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790391747.606466:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877361186557824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391747.606564:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877361186557824:12345-0@lo:400:kworker.0 Request processed in 102us (12109us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391747.606572:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790391747.606608:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186557568:0@lo:8:kworker.0 00000400:00000100:2.0:1790391747.606758:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877361186557568 offset 0 length 520: 4 00010000:00080000:1.0:1790391747.606778:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e51820ad500 x1877361186557824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391747.606791:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877361186557824:0@lo:400:kworker.0 00000100:00100000:2.0:1790391747.606799:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186557696:0@lo:8:kworker.0 00000400:00000100:2.0:1790391747.606833:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877361186557696 offset 0 length 520: 4 00000100:00100000:2.0:1790391747.606865:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790391747.606874:0:22781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bb399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186557952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391747.606934:0:22781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bb399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186557952:12345-0@lo:400:kworker.0 Request processed in 61us (12483us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391747.606941:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790391747.606997:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e907dcd1-fffe-43bb-853f-376b925bb229:3638:1877361186557312:0@lo:400:kworker.0 00000100:00100000:2.0:1790391747.607017:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186557952:0@lo:400:kworker.0 00000100:00100000:0.0:1790391747.607138:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bb398e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877361186558080:12345-0@lo:400:kworker.0 Request processed in 4925us (12731us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391747.607147:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1790391747.607197:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e51820ac380 x1877361186558080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391747.607208:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877361186558080:0@lo:400:kworker.0 00000100:00100000:3.0:1790391747.607377:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7676450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+18:3638:x1877361186557312:12345-0@lo:400:kworker.0 Request processed in 12842us (13036us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391747.607386:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000020:00000004:1.0:1790391748.277578:0:23882:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790391748.277869:0:23882:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790391748.424818:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790391749.376738:0:23930:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffea6d6b460 20000000:00000080:1.0:1790391749.376758:0:23930:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e52ae6cf000 uarg=0000000000000000 20000000:01000000:1.0:1790391749.376806:0:23930:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1790391749.376813:0:23930:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1790391749.376817:0:23930:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1790391749.392417:0:23931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1790391749.393320:0:23930:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1790391749.406212:0:23930:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790391749.409391:0:23930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e52bab9d600/0x2b1b7949f13e2b10 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391749.409419:0:23930:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5184055a00/0x2b1b7949f13e29b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e29b2 expref: 17 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391749.409448:0:23930:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e52bab9c800/0x2b1b7949f13e2abc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2ab5 expref: 17 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391749.409456:0:23930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e52bab9d600/0x2b1b7949f13e2b10 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391749.409505:0:23930:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e52bab9c800/0x2b1b7949f13e2abc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e2ab5 expref: 17 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391749.409522:0:23930:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e52bab9c800/0x2b1b7949f13e2abc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e2ab5 expref: 17 pid: 22770 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391749.409539:0:23930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb39a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23930:1877361186558208:0@lo:104: 00000100:00100000:3.0:1790391749.409612:0:23930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790391749.409738:0:23930:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5184055a00/0x2b1b7949f13e29b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e29b2 expref: 17 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391749.409746:0:23930:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e5184055a00/0x2b1b7949f13e29b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e29b2 expref: 17 pid: 22771 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391749.409755:0:23930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb39aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23930:1877361186558336:0@lo:104: 00000100:00100000:3.0:1790391749.409776:0:23930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391749.412958:0:23930:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528820d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391749.414341:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186558208 00000100:00100000:2.0:1790391749.414355:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186558208 00000100:00100000:3.0:1790391749.414486:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186558336 00000100:00100000:3.0:1790391749.414490:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186558336 00000100:00100000:3.0:1790391749.414506:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790391749.414514:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bb398700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e907dcd1-fffe-43bb-853f-376b925bb229+4:23930:x1877361186558208:12345-0@lo:104: 00010000:00010000:3.0:1790391749.414532:0:22760:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e5295145c00/0x2b1b7949f13e2ab5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e2abc expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391749.414641:0:22760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790391749.414648:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bb398700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e907dcd1-fffe-43bb-853f-376b925bb229+4:23930:x1877361186558208:12345-0@lo:104: Request processed in 135us (5037us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391749.414664:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790391749.414683:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790391749.414689:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bb39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e907dcd1-fffe-43bb-853f-376b925bb229+3:23930:x1877361186558336:12345-0@lo:104: 00010000:00010000:3.0:1790391749.414697:0:22760:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e52bab9ce00/0x2b1b7949f13e29b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e29b9 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391749.414732:0:22760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790391749.414737:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bb39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e907dcd1-fffe-43bb-853f-376b925bb229+3:23930:x1877361186558336:12345-0@lo:104: Request processed in 50us (4961us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391749.414743:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1790391749.414761:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790391749.414768:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e5295145c00/0x2b1b7949f13e2ab5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e2abc expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391749.414774:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295145c00 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:3.0:1790391749.414779:0:22765:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e5295145c00/0x2b1b7949f13e2ab5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e2abc expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391749.414788:0:22765:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5295145c00/0x2b1b7949f13e2ab5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e2abc expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790391749.414794:0:22765:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5295145c00/0x2b1b7949f13e2ab5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e2abc expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391749.414799:0:22765:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790391749.414844:0:22765:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e5295145c00/0x2b1b7949f13e2ab5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e2abc expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391749.414851:0:22765:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790391749.414870:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e5295145c00/0x2b1b7949f13e2ab5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e2abc expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391749.414910:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5295145c00/0x2b1b7949f13e2ab5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e2abc expref: -99 pid: 23509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391749.414924:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391749.414927:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e52bab9ce00/0x2b1b7949f13e29b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e29b9 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391749.414933:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52bab9ce00 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:3.0:1790391749.414935:0:22765:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e52bab9ce00/0x2b1b7949f13e29b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e29b9 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391749.414942:0:22765:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e52bab9ce00/0x2b1b7949f13e29b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e29b9 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790391749.414948:0:22765:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e52bab9ce00/0x2b1b7949f13e29b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e29b9 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391749.414953:0:22765:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790391749.414965:0:22765:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e52bab9ce00/0x2b1b7949f13e29b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e29b9 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391749.414971:0:22765:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790391749.414977:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e52bab9ce00/0x2b1b7949f13e29b2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e29b9 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391749.414992:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e52bab9ce00/0x2b1b7949f13e29b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e29b9 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391749.415006:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391749.415008:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391749.415009:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391749.415162:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb398a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e907dcd1-fffe-43bb-853f-376b925bb229:3639:1877361186558464:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790391749.415208:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391749.415252:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790391749.415258:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb399500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e907dcd1-fffe-43bb-853f-376b925bb229:3639:1877361186558592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790391749.415280:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391749.415327:0:23930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb39a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23930:1877361186558208:0@lo:104: 00000100:00100000:1.0:1790391749.415335:0:23930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb39aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23930:1877361186558336:0@lo:104: 00010000:00010000:1.0:1790391749.415355:0:23930:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e52bab9d600/0x2b1b7949f13e2b10 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391749.421174:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186558464 00000100:00100000:3.0:1790391749.421191:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186558464 00010000:00010000:3.0:1790391749.421245:0:22763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e52bab9c800/0x2b1b7949f13e2abc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e2ab5 expref: 18 pid: 22770 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391749.421279:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186558592 00000100:00100000:3.0:1790391749.421283:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186558592 00010000:00010000:3.0:1790391749.421295:0:22763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5184055a00/0x2b1b7949f13e29b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e29b2 expref: 19 pid: 22771 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391749.421310:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790391749.421318:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518331ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e907dcd1-fffe-43bb-853f-376b925bb229+19:3639:x1877361186558464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790391749.421335:0:22763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391749.421340:0:22763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e52bab9c800/0x2b1b7949f13e2abc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e2ab5 expref: 19 pid: 22770 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391749.421352:0:22763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e52bab9c800/0x2b1b7949f13e2abc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e2ab5 expref: 19 pid: 22770 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391749.421371:0:22763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52bab9c800/0x2b1b7949f13e2abc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e2ab5 expref: 19 pid: 22770 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391749.421388:0:22763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391749.421508:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518331ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e907dcd1-fffe-43bb-853f-376b925bb229+18:3639:x1877361186558464:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (6298us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391749.421516:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790391749.421536:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790391749.421542:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518331f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e907dcd1-fffe-43bb-853f-376b925bb229+17:3639:x1877361186558592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790391749.421554:0:22763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391749.421559:0:22763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5184055a00/0x2b1b7949f13e29b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e29b2 expref: 17 pid: 22771 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391749.421567:0:22763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5184055a00/0x2b1b7949f13e29b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e29b2 expref: 17 pid: 22771 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391749.421576:0:22763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5184055a00/0x2b1b7949f13e29b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e29b2 expref: 17 pid: 22771 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391749.421587:0:22763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e52bab9d600/0x2b1b7949f13e2b10 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391749.421607:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52bab9d600/0x2b1b7949f13e2b10 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391749.421624:0:22763:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e52bab9d600/0x2b1b7949f13e2b10 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391749.421630:0:22763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e52bab9d600/0x2b1b7949f13e2b10 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391749.421636:0:22763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e52bab9d600/0x2b1b7949f13e2b10 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391749.421643:0:22763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e52bab9d600/0x2b1b7949f13e2b10 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391749.422146:0:22763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52bab9d600 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:3.0:1790391749.422152:0:22763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e52bab9d600/0x2b1b7949f13e2b10 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391749.422161:0:22763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e52bab9d600/0x2b1b7949f13e2b10 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391749.422173:0:22763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e52bab9d600/0x2b1b7949f13e2b10 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391749.422184:0:22763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391749.422219:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518331f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e907dcd1-fffe-43bb-853f-376b925bb229+16:3639:x1877361186558592:12345-0@lo:103:ldlm_bl.0 Request processed in 677us (6938us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391749.422226:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790391749.422272:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb399500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e907dcd1-fffe-43bb-853f-376b925bb229:3639:1877361186558592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790391749.422282:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb398a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e907dcd1-fffe-43bb-853f-376b925bb229:3639:1877361186558464:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790391749.422361:0:23930:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e52bab9d600/0x2b1b7949f13e2b10 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391749.422370:0:23930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e52bab9d600/0x2b1b7949f13e2b10 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391749.422376:0:23930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52bab9d600/0x2b1b7949f13e2b10 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391749.424142:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391749.448105:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391750.473554:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790391750.537864:0:22773:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790391750.537903:0:22773:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e5284985000 from 13 10000000:01000000:3.0:1790391750.537909:0:22773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790391750.537962:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c800/0x2b1b7949f13e2b17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391750.537974:0:22773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c800/0x2b1b7949f13e2b17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391750.537987:0:22773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c800/0x2b1b7949f13e2b17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391750.538037:0:22773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb398a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186558720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790391750.538127:0:22773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391750.538190:0:22773:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528820d180 going to sleep for 11 seconds 00000100:00100000:0.0:1790391750.538312:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186558720 00000100:00100000:0.0:1790391750.538320:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186558720 00000100:00100000:0.0:1790391750.538387:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790391750.538397:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+16:22773:x1877361186558720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790391750.538430:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391750.538447:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5295144400/0x2b1b7949f13e2b1e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e2b17 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391750.538474:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5295144400/0x2b1b7949f13e2b1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e2b17 expref: 17 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391750.538486:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5295144400/0x2b1b7949f13e2b1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2b17 expref: 17 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391750.538495:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5295144400, rc 0) 00000100:00100000:0.0:1790391750.538541:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+17:22773:x1877361186558720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391750.538548:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790391750.538600:0:22773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb398a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186558720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790391750.538615:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c800/0x2b1b7949f13e2b17 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2b1e expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391750.538623:0:22773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c800/0x2b1b7949f13e2b17 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e2b1e expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391750.538684:0:22773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186558848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391750.538709:0:22773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391750.538721:0:22773:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e518330a240 going to sleep for 11 seconds 00000100:00100000:3.0:1790391750.538918:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186558848 00000100:00100000:3.0:1790391750.538924:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186558848 00000100:00100000:3.0:1790391750.538945:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790391750.538951:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+17:22773:x1877361186558848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391750.539075:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+17:22773:x1877361186558848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 123us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391750.539082:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790391750.540304:0:22773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186558848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391750.540363:0:22773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186558976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790391750.540430:0:22773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391750.540466:0:22773:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e518330a240 going to sleep for 11 seconds 00000100:00100000:3.0:1790391750.540570:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186558976 00000100:00100000:3.0:1790391750.540576:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186558976 00000100:00100000:3.0:1790391750.540619:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790391750.540627:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+17:22773:x1877361186558976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790391750.540721:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+17:22773:x1877361186558976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391750.540728:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790391750.542013:0:22773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186558976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790391750.543261:0:23988:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1790391750.543573:0:22773:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1790391750.543597:0:22773:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790391750.543610:0:22773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c800/0x2b1b7949f13e2b17 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2b1e expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391750.543622:0:22773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c800/0x2b1b7949f13e2b17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2b1e expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391750.543633:0:22773:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790391750.543648:0:22773:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e52b56dd000 from 13 10000000:01000000:3.0:1790391750.543651:0:22773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790391750.543689:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52bab9ce00/0x2b1b7949f13e2b25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391750.543698:0:22773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e52bab9ce00/0x2b1b7949f13e2b25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391750.543708:0:22773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52bab9ce00/0x2b1b7949f13e2b25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391750.543733:0:22773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb399500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186559104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790391750.543802:0:22773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391750.543834:0:22773:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528820d840 going to sleep for 11 seconds 00000100:00100000:0.0:1790391750.544267:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186559104 00000100:00100000:0.0:1790391750.544276:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186559104 00000100:00100000:0.0:1790391750.544326:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790391750.544336:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+17:22773:x1877361186559104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790391750.544483:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391750.544499:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5295145600/0x2b1b7949f13e2b2c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e2b25 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391750.544524:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5295145600/0x2b1b7949f13e2b2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e2b25 expref: 18 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391750.544534:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5295145600/0x2b1b7949f13e2b2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2b25 expref: 18 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391750.544543:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5295145600, rc 0) 00000100:00100000:0.0:1790391750.544596:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+18:22773:x1877361186559104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 262us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391750.544604:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790391750.544652:0:22773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb399500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186559104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790391750.544667:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52bab9ce00/0x2b1b7949f13e2b25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2b2c expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391750.544676:0:22773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52bab9ce00/0x2b1b7949f13e2b25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e2b2c expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391750.544744:0:22773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186559232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391750.544770:0:22773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391750.544785:0:22773:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e518330ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1790391750.544800:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186559232 00000100:00100000:0.0:1790391750.544804:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186559232 00000100:00100000:0.0:1790391750.544828:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790391750.544834:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+18:22773:x1877361186559232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391750.544962:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+18:22773:x1877361186559232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 127us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391750.544968:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790391750.545012:0:22773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186559232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391750.545038:0:22773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186559360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790391750.545086:0:22773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391750.545099:0:22773:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e518330ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1790391750.545110:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186559360 00000100:00100000:0.0:1790391750.545113:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186559360 00000100:00100000:0.0:1790391750.545134:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790391750.545140:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+18:22773:x1877361186559360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790391750.547911:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+18:22773:x1877361186559360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2726us (2780us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391750.547925:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790391750.552546:0:22773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186559360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790391750.567115:0:23989:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1790391750.567353:0:22773:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1790391750.567379:0:22773:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790391750.567391:0:22773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52bab9ce00/0x2b1b7949f13e2b25 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2b2c expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391750.567403:0:22773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e52bab9ce00/0x2b1b7949f13e2b25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2b2c expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391751.176576:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790391751.176600:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186559488:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790391751.176669:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391751.176720:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186559488 00000100:00100000:1.0:1790391751.176728:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186559488 00000100:00100000:1.0:1790391751.176786:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790391751.176796:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bb398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186559488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790391751.176831:0:22782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1790391751.176901:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bb398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186559488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391751.176909:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790391751.176929:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186559488:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1790391751.503607:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391751.688329:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790391741/real 1790391741] req@ffff9e52bb39b800 x1877361186552576/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391751 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391751.688373:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e52bb39b800 x1877361186552576/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391751 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391751.688384:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790391741/real 1790391741] req@ffff9e51820ace00 x1877361186552448/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391751 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391751.688394:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e51820ace00 x1877361186552448/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391751 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790391751.688416:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e52b5cbb800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790391751.688426:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1790391751.688431:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb39b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186552576:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1790391751.688437:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e52b75c1000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790391751.688441:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1790391751.688444:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186552448:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1790391751.690229:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790391751.690236:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790391751.690239:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790391751.690242:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790391751.690273:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790391751.690276:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1790391751.690280:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e52b75c1000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790391751.690289:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 654 00000100:00080000:2.0:1790391751.690296:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790391751.690304:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9e52b75c1000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:2.0:1790391751.690327:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e51831dc380 x1877361186560128/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790391751.691030:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790391751.691034:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790391751.691036:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e52b5cbb800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790391751.691040:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 654 00000100:00080000:2.0:1790391751.691043:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790391751.691048:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e52b5cbb800 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:2.0:1790391751.691079:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e51831dd500 x1877361186560256/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790391751.691124:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e907dcd1-fffe-43bb-853f-376b925bb229:3638:1877361186559616:0@lo:400:kworker.0 00000100:00100000:2.0:1790391751.691417:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391751.691466:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877361186560384:0@lo:400:kworker.0 00000100:00100000:2.0:1790391751.691495:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391751.692129:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790391751.692152:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186560000:0@lo:400:kworker.0 00000100:00100000:2.0:1790391751.692190:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391751.692233:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186559744:0@lo:400:kworker.0 00000100:00100000:2.0:1790391751.692270:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391751.692290:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790391751.692296:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877361186559872:0@lo:400:kworker.0 00000100:00100000:2.0:1790391751.692316:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391751.693260:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186559616 00000100:00100000:2.0:1790391751.693273:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186559616 00000100:00100000:2.0:1790391751.694101:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790391751.694116:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b778f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+18:3638:x1877361186559616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391751.696060:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b778f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+18:3638:x1877361186559616:12345-0@lo:400:kworker.0 Request processed in 1933us (4627us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391751.696074:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790391751.696140:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186560384 00000100:00100000:2.0:1790391751.696150:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186560384 00000100:00100000:2.0:1790391751.696204:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186559872 00000100:00100000:2.0:1790391751.696208:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186559872 00000100:00100000:2.0:1790391751.696232:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790391751.696240:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877361186560384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391751.696298:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877361186560384:12345-0@lo:400:kworker.0 Request processed in 58us (4802us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391751.696305:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790391751.696317:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790391751.696323:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877361186559872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391751.696351:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877361186559872:12345-0@lo:400:kworker.0 Request processed in 28us (4034us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391751.696357:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790391751.696377:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186560000 00000100:00100000:2.0:1790391751.696381:0:22781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186560000 00000100:00100000:2.0:1790391751.696416:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186559744 00000100:00100000:2.0:1790391751.696419:0:22781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186559744 00000100:00100000:2.0:1790391751.696430:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790391751.696434:0:22781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186560000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391751.696466:0:22781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186560000:12345-0@lo:400:kworker.0 Request processed in 31us (4275us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391751.696471:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790391751.696481:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790391751.696487:0:22781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1877361186559744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391751.696513:0:22781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1877361186559744:12345-0@lo:400:kworker.0 Request processed in 27us (4243us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391751.696519:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790391751.696543:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790391751.696559:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186560512:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790391751.696592:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1790391751.696646:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e51831df480 x1877361186559872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391751.696664:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877361186559872:0@lo:400:kworker.0 00000100:00100000:2.0:1790391751.696673:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186559744:0@lo:400:kworker.0 00000100:00100000:2.0:1790391751.696691:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186560512 00000100:00100000:2.0:1790391751.696694:0:22781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186560512 00000100:00100000:2.0:1790391751.696711:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790391751.696716:0:22781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1877361186560512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790391751.696739:0:22781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790391751.696774:0:22781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1877361186560512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391751.696788:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790391751.696818:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186560512:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790391751.696840:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186560128:0@lo:8:kworker.0 00000400:00000100:2.0:1790391751.696865:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877361186560128 offset 0 length 520: 4 00000100:00100000:2.0:1790391751.696915:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186560256:0@lo:8:kworker.0 00000400:00000100:2.0:1790391751.696934:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877361186560256 offset 0 length 520: 4 00000100:00100000:0.0:1790391751.705594:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e907dcd1-fffe-43bb-853f-376b925bb229:3638:1877361186559616:0@lo:400:kworker.0 00010000:00080000:0.0:1790391751.705622:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e51831df100 x1877361186560384/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391751.705651:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877361186560384:0@lo:400:kworker.0 00000100:00100000:0.0:1790391751.705686:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186560000:0@lo:400:kworker.0 00010000:00010000:1.0:1790391752.520288:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790391752.714267:0:23510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:3.0:1790391753.416736:0:23532:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790391753.549021:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790391754.312691:0:22810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790391754.569047:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391755.592233:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391756.314414:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186560640:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790391756.314505:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391756.314692:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186560640 00000100:00100000:1.0:1790391756.314703:0:22781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186560640 00000100:00100000:1.0:1790391756.314764:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790391756.314773:0:22781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bb39b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186560640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790391756.314808:0:22781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1790391756.314858:0:22781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bb39b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186560640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391756.314865:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790391756.314933:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186560640:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1790391756.617281:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790391756.696908:0:24279:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790391756.696912:0:24279:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1790391756.696914:0:24279:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1790391756.697181:0:24279:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e52a75c7800 00000020:01000004:0.0:1790391756.697198:0:24279:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1790391756.697212:0:24279:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1790391756.697227:0:24279:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9e5183380000) 00000020:00000080:0.0:1790391756.697243:0:24279:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1790391756.742313:0:24279:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1790391756.745425:0:24279:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1790391756.745820:0:24279:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1790391756.746323:0:24279:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1790391756.746626:0:24279:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1790391756.746792:0:24279:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1790391756.747128:0:24279:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:2.0:1790391756.748850:0:24279:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1790391756.749282:0:24279:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1790391756.749294:0:24279:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790391756.749305:0:24279:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2b1b7949f13e2b3a 00000020:01000004:2.0:1790391756.749312:0:24279:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1790391756.749334:0:24279:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.128@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790391756.749338:0:24279:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.128@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790391756.749344:0:24279:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1790391756.749349:0:24279:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1790391756.749360:0:24279:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9e52ae680000) 00000020:00000080:2.0:1790391756.749371:0:24279:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1790391756.750602:0:24279:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790391756.750786:0:24279:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1790391756.750793:0:24279:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1790391756.755244:0:24279:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1790391756.755258:0:24279:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1790391756.755753:0:24279:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1790391756.755762:0:24279:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1790391756.757782:0:24279:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790391756.759111:0:24279:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1790391756.759119:0:24279:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1790391756.760853:0:24279:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1790391756.760864:0:24279:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1790391756.790271:0:24279:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790391756.791396:0:24279:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1790391756.791406:0:24279:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1790391756.794246:0:24279:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1790391756.794262:0:24279:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1790391756.796446:0:24279:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1790391756.796461:0:24279:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1790391756.799468:0:24279:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790391756.800127:0:24279:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1790391756.800134:0:24279:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1790391756.801120:0:24279:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1790391756.801130:0:24279:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1790391756.812755:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790391756.812781:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186560768:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790391756.812857:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391756.812942:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186560768 00000100:00100000:1.0:1790391756.812950:0:22781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186560768 00000100:00100000:1.0:1790391756.813000:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790391756.813019:0:22781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518331ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186560768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790391756.813054:0:22781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790391756.813105:0:22781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518331ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186560768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391756.813112:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790391756.813164:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186560768:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1790391756.815953:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790391756.815959:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790391756.815962:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790391756.815965:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790391756.815988:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790391756.815992:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790391756.815995:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790391756.815998:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790391756.816057:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb399f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186561280:0@lo:400:kworker.0 00000100:00100000:3.0:1790391756.816135:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391756.816181:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790391756.816187:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb398380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e907dcd1-fffe-43bb-853f-376b925bb229:3637:1877361186560896:0@lo:400:kworker.0 00000100:00100000:3.0:1790391756.816220:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391756.816272:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186561280 00000100:00100000:3.0:1790391756.816280:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186561280 00000100:00100000:3.0:1790391756.816328:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790391756.816336:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bb39ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186561280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391756.816388:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bb39ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186561280:12345-0@lo:400:kworker.0 Request processed in 53us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391756.816395:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790391756.816418:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186560896 00000100:00100000:3.0:1790391756.816421:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186560896 00000100:00100000:3.0:1790391756.816445:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790391756.816451:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b778f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+18:3637:x1877361186560896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391756.816491:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b778f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+18:3637:x1877361186560896:12345-0@lo:400:kworker.0 Request processed in 40us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391756.816497:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790391756.816546:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb398380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e907dcd1-fffe-43bb-853f-376b925bb229:3637:1877361186560896:0@lo:400:kworker.0 00010000:00080000:3.0:1790391756.816561:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e52bb399f80 x1877361186561280/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391756.816572:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb399f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186561280:0@lo:400:kworker.0 00000100:00100000:1.0:1790391756.816967:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb39b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877361186561024:0@lo:400:kworker.0 00000100:00100000:1.0:1790391756.817001:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391756.817041:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790391756.817055:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb399880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186561152:0@lo:400:kworker.0 00000100:00100000:1.0:1790391756.817085:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391756.817118:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186561152 00000100:00100000:1.0:1790391756.817122:0:22781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186561152 00000100:00100000:1.0:1790391756.817149:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790391756.817156:0:22781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518331d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186561152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391756.817195:0:22781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518331d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186561152:12345-0@lo:400:kworker.0 Request processed in 39us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391756.817201:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790391756.817226:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb399880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186561152:0@lo:400:kworker.0 00000100:00100000:2.0:1790391756.817424:0:23840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186561024 00000100:00100000:2.0:1790391756.817428:0:23840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186561024 00000100:00100000:2.0:1790391756.817451:0:23840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790391756.817457:0:23840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518331c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877361186561024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391756.817499:0:23840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518331c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877361186561024:12345-0@lo:400:kworker.0 Request processed in 42us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391756.817506:0:23840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1790391756.817568:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e52bb39b100 x1877361186561024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391756.817579:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb39b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877361186561024:0@lo:400:kworker.0 00000100:00100000:1.0:1790391756.860219:0:24279:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790391756.861984:0:24279:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1790391756.861997:0:24279:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1790391756.866280:0:24279:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1790391756.866293:0:24279:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1790391756.872267:0:24279:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1790391756.872311:0:24279:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1790391756.872319:0:24279:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.128@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1790391756.959701:0:24279:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.128@tcp ctxt 0 is initialized 00000020:01000004:1.0:1790391756.959741:0:24279:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.128@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1790391756.959746:0:24279:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1790391756.959748:0:24279:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790391756.959749:0:24279:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790391756.959750:0:24279:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790391756.959752:0:24279:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790391756.959753:0:24279:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790391756.959754:0:24279:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790391756.959756:0:24279:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790391756.959757:0:24279:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790391756.959761:0:24279:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1790391756.959763:0:24279:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790391756.959764:0:24279:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790391756.959765:0:24279:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790391756.959766:0:24279:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790391756.959767:0:24279:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790391756.959768:0:24279:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790391756.959769:0:24279:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790391756.959770:0:24279:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790391756.959775:0:24279:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790391756.959804:0:24279:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1790391756.959836:0:24279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:24279:1877361186561408:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790391756.963114:0:24279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391756.963174:0:24279:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b5f9a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391756.964600:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186561408 00000100:00100000:2.0:1790391756.964614:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186561408 00000100:00100000:2.0:1790391756.964689:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790391756.964702:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b778d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+18:24279:x1877361186561408:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790391756.964774:0:22770:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1790391756.964778:0:22770:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1790391756.964783:0:22770:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1790391756.966850:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b778d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+18:24279:x1877361186561408:12345-0@lo:253:mount.lustre.0 Request processed in 2143us (3737us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391756.966871:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790391756.972522:0:24279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:24279:1877361186561408:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790391756.972548:0:24279:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1790391756.972552:0:24279:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790391756.972554:0:24279:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790391756.972555:0:24279:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790391756.972556:0:24279:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790391756.972557:0:24279:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790391756.972558:0:24279:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790391756.972559:0:24279:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790391756.972561:0:24279:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790391756.972562:0:24279:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790391756.972601:0:24279:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e52a75c7800 from lustre-OST0000 10000000:01000000:0.0:1790391756.972639:0:24279:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1790391756.972642:0:24279:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1790391756.972650:0:24279:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e52b9d719c0 local copy 00010000:00010000:0.0:1790391756.972661:0:24279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e518309d400/0x2b1b7949f13e28f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e28fc expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391756.972801:0:24279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:24279:1877361186561536:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790391756.972909:0:24279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391756.972958:0:24279:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e518330a300 going to sleep for 11 seconds 00000100:00100000:3.0:1790391756.973383:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186561536 00000100:00100000:3.0:1790391756.973392:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186561536 00000100:00100000:3.0:1790391756.973440:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790391756.973450:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b778c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+18:24279:x1877361186561536:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790391756.973539:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b778c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+18:24279:x1877361186561536:12345-0@lo:501:mount.lustre.0 Request processed in 91us (630us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790391756.973548:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790391756.974267:0:24279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:24279:1877361186561536:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1790391756.974291:0:24279:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.128@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1790391756.974327:0:24279:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.128@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1790391756.974336:0:24279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e518309d400/0x2b1b7949f13e28f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e28fc expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391756.974346:0:24279:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e518309d400/0x2b1b7949f13e28f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e28fc expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391756.974383:0:24279:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e52a75c7800 10000000:01000000:0.0:1790391756.974388:0:24279:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1790391756.974394:0:24279:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1790391756.974396:0:24279:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790391756.974401:0:24279:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1790391756.974404:0:24279:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1790391756.974437:0:24279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295145000/0x2b1b7949f13e2b48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391756.974445:0:24279:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e5295145000/0x2b1b7949f13e2b48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391756.974455:0:24279:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e5295145000/0x2b1b7949f13e2b48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391756.975324:0:24279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:24279:1877361186561664:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790391756.975392:0:24279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391756.975429:0:24279:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e518330a300 going to sleep for 11 seconds 00000100:00100000:2.0:1790391756.975529:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186561664 00000100:00100000:2.0:1790391756.975539:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186561664 00000100:00100000:2.0:1790391756.975606:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790391756.975616:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b778e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+18:24279:x1877361186561664:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790391756.975632:0:22770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391756.975649:0:22770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e518309da00/0x2b1b7949f13e2b4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e2b48 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391756.975674:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e518309da00/0x2b1b7949f13e2b4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e2b48 expref: 19 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391756.975686:0:22770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e518309da00/0x2b1b7949f13e2b4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2b48 expref: 19 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391756.975695:0:22770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309da00, rc 0) 00000100:00100000:2.0:1790391756.975742:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b778e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+19:24279:x1877361186561664:12345-0@lo:101:mount.lustre.0 Request processed in 126us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391756.975749:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790391756.976772:0:24279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:24279:1877361186561664:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790391756.976795:0:24279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e5295145000/0x2b1b7949f13e2b48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2b4f expref: -99 pid: 24279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391756.976806:0:24279:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e5295145000/0x2b1b7949f13e2b48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e2b4f expref: -99 pid: 24279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790391756.991591:0:24279:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:2.0:1790391757.002142:0:24279:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790391757.015181:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1790391757.015251:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1790391757.015267:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1790391757.015280:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1790391757.015291:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1790391757.015303:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1790391757.015315:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1790391757.015329:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1790391757.015342:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:2.0:1790391757.015356:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:2.0:1790391757.015368:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:2.0:1790391757.015383:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:2.0:1790391757.015409:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:2.0:1790391757.015415:0:24279:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:2.0:1790391757.016169:0:24279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:24279:1877361186561792:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790391757.016247:0:24279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391757.017875:0:24279:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528515de40 going to sleep for 11 seconds 00000100:00100000:1.0:1790391757.027270:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186561792 00000100:00100000:1.0:1790391757.027290:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186561792 00000100:00100000:1.0:1790391757.027374:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790391757.027386:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+19:24279:x1877361186561792:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790391757.027993:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+19:24279:x1877361186561792:12345-0@lo:501:mount.lustre.0 Request processed in 608us (11744us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391757.028033:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790391757.029698:0:24279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:24279:1877361186561792:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790391757.029773:0:24279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:24279:1877361186561920:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790391757.030917:0:24279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391757.030999:0:24279:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e518330ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1790391757.031020:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186561920 00000100:00100000:3.0:1790391757.031030:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186561920 00000100:00100000:3.0:1790391757.031080:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790391757.031089:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+19:24279:x1877361186561920:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790391757.031980:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+19:24279:x1877361186561920:12345-0@lo:503:mount.lustre.0 Request processed in 889us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391757.031991:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790391757.032174:0:24279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:24279:1877361186561920:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790391757.032701:0:24279:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790391757.032794:0:24279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:24279:1877361186562048:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790391757.032847:0:24279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391757.033174:0:24279:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528515d600 going to sleep for 11 seconds 00000100:00100000:1.0:1790391757.044353:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186562048 00000100:00100000:1.0:1790391757.044369:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186562048 00000100:00100000:1.0:1790391757.044425:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790391757.044433:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+19:24279:x1877361186562048:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790391757.045554:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+19:24279:x1877361186562048:12345-0@lo:502:mount.lustre.0 Request processed in 1114us (12699us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391757.045568:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790391757.045750:0:24279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:24279:1877361186562048:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790391757.046687:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1790391757.046729:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1790391757.046751:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1790391757.046763:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1790391757.046775:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1790391757.046788:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1790391757.046799:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1790391757.046815:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1790391757.047237:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:3.0:1790391757.047279:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:3.0:1790391757.047295:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:3.0:1790391757.047307:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:3.0:1790391757.047354:0:24279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb39b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:24279:1877361186562176:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790391757.047442:0:24279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391757.047666:0:24279:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e93c240 going to sleep for 11 seconds 00000100:00100000:0.0:1790391757.051264:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186562176 00000100:00100000:0.0:1790391757.051282:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186562176 00000100:00100000:1.0:1790391757.056773:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790391757.056787:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+19:24279:x1877361186562176:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790391757.057030:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+19:24279:x1877361186562176:12345-0@lo:502:mount.lustre.0 Request processed in 246us (9587us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391757.057039:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790391757.057144:0:24279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb39b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:24279:1877361186562176:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790391757.057240:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:0.0:1790391757.057254:0:24279:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1790391757.061605:0:24296:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790391757.061618:0:24296:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1790391757.061625:0:24296:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391757.061628:0:24296:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1790391757.061634:0:24296:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790391757.061650:0:24296:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9e52ae683380) 00000020:00000080:2.0:1790391757.061692:0:24296:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1790391757.061699:0:24296:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790391757.061788:0:24296:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e52a75c7800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1790391757.061796:0:24296:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790391757.061803:0:24296:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2b1b7949f13e2b5d 00010000:00010000:3.0:1790391757.081132:0:24296:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1790391757.081672:0:24296:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:3.0:1790391757.084537:0:24296:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:1.0:1790391757.086212:0:24296:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1790391757.086224:0:24296:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790391757.086230:0:24296:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391757.086233:0:24296:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1790391757.086236:0:24296:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790391757.086246:0:24296:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1790391757.086248:0:24296:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790391757.086250:0:24296:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790391757.086252:0:24296:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790391757.086255:0:24296:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391757.086256:0:24296:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790391757.086259:0:24296:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790391757.086263:0:24296:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391757.086264:0:24296:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790391757.086268:0:24296:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790391757.086269:0:24296:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790391757.086272:0:24296:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790391757.086274:0:24296:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391757.086276:0:24296:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1790391757.086278:0:24296:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790391757.086280:0:24296:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391757.086282:0:24296:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790391757.086285:0:24296:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1790391757.086316:0:24296:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790391757.086319:0:24296:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391757.086320:0:24296:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790391757.086323:0:24296:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:3.0:1790391757.087979:0:24279:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1790391757.088033:0:24279:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1790391757.088058:0:24279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295145000/0x2b1b7949f13e2b48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2b4f expref: -99 pid: 24279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391757.088071:0:24279:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5295145000/0x2b1b7949f13e2b48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2b4f expref: -99 pid: 24279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391757.088079:0:24279:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e52a75c7800 from 1 10000000:01000000:3.0:1790391757.088082:0:24279:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790391757.088124:0:24279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d000/0x2b1b7949f13e2b64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391757.088143:0:24279:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d000/0x2b1b7949f13e2b64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391757.088154:0:24279:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d000/0x2b1b7949f13e2b64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391757.088181:0:24279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb399f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:24279:1877361186562304:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790391757.088249:0:24279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391757.088290:0:24279:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e93c240 going to sleep for 11 seconds 00000100:00100000:1.0:1790391757.089050:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186562304 00000100:00100000:1.0:1790391757.089060:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186562304 00000100:00100000:1.0:1790391757.089108:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790391757.089117:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+19:24279:x1877361186562304:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790391757.089130:0:22770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391757.089143:0:22770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5184055c00/0x2b1b7949f13e2b6b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e2b64 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391757.089167:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5184055c00/0x2b1b7949f13e2b6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e2b64 expref: 20 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391757.089178:0:22770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5184055c00/0x2b1b7949f13e2b6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2b64 expref: 20 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391757.089194:0:22770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5184055c00, rc 0) 00000100:00100000:1.0:1790391757.089241:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+20:24279:x1877361186562304:12345-0@lo:101:mount.lustre.0 Request processed in 125us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391757.089247:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790391757.089333:0:24279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb399f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:24279:1877361186562304:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790391757.089349:0:24279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d000/0x2b1b7949f13e2b64 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2b6b expref: -99 pid: 24279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391757.089358:0:24279:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d000/0x2b1b7949f13e2b64 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e2b6b expref: -99 pid: 24279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790391757.091192:0:24279:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1790391757.091472:0:24279:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790391757.091812:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1790391757.091836:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1790391757.092908:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1790391757.092937:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1790391757.092950:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1790391757.092963:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1790391757.092977:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1790391757.092991:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1790391757.093016:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1790391757.093031:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1790391757.093057:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1790391757.093079:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1790391757.093085:0:24279:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1790391757.093191:0:24279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb399f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:24279:1877361186562432:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790391757.093279:0:24279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391757.093319:0:24279:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e93c540 going to sleep for 11 seconds 00000100:00100000:2.0:1790391757.093990:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186562432 00000100:00100000:2.0:1790391757.094009:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186562432 00000100:00100000:2.0:1790391757.094103:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790391757.094113:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+20:24279:x1877361186562432:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790391757.094258:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+20:24279:x1877361186562432:12345-0@lo:501:mount.lustre.0 Request processed in 147us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391757.094266:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790391757.094435:0:24279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb399f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:24279:1877361186562432:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790391757.094477:0:24279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb399f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:24279:1877361186562560:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790391757.094544:0:24279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391757.100205:0:24279:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e93c540 going to sleep for 11 seconds 00000100:00100000:0.0:1790391757.100705:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186562560 00000100:00100000:0.0:1790391757.100716:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186562560 00000100:00100000:1.0:1790391757.100845:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790391757.100864:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+20:24279:x1877361186562560:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790391757.105944:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+20:24279:x1877361186562560:12345-0@lo:503:mount.lustre.0 Request processed in 5080us (11389us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391757.105958:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790391757.106187:0:24279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb399f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:24279:1877361186562560:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790391757.106642:0:24279:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790391757.106745:0:24279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:24279:1877361186562688:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790391757.106809:0:24279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391757.106853:0:24279:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a7638900 going to sleep for 11 seconds 00000100:00100000:1.0:1790391757.107696:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186562688 00000100:00100000:1.0:1790391757.107706:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186562688 00000100:00100000:1.0:1790391757.107765:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790391757.107774:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+20:24279:x1877361186562688:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790391757.107948:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+20:24279:x1877361186562688:12345-0@lo:502:mount.lustre.0 Request processed in 175us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391757.107956:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790391757.110165:0:24279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:24279:1877361186562688:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790391757.110477:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1790391757.110512:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1790391757.110527:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1790391757.110538:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1790391757.110551:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1790391757.110563:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1790391757.110577:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1790391757.110605:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:0.0:1790391757.110620:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1790391757.110632:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:0.0:1790391757.110643:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:0.0:1790391757.110681:0:24279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:24279:1877361186562816:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790391757.110753:0:24279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391757.110795:0:24279:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a7638900 going to sleep for 11 seconds 00000100:00100000:0.0:1790391757.110821:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186562816 00000100:00100000:0.0:1790391757.110827:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186562816 00000100:00100000:0.0:1790391757.110910:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790391757.110919:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282b66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+20:24279:x1877361186562816:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790391757.111047:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282b66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+20:24279:x1877361186562816:12345-0@lo:502:mount.lustre.0 Request processed in 129us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391757.111054:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790391757.111112:0:24279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:24279:1877361186562816:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790391757.111151:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:0.0:1790391757.111159:0:24279:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1790391757.113375:0:24300:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790391757.113387:0:24300:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391757.113390:0:24300:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790391757.113396:0:24300:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e52a75c7800 00000020:00000080:1.0:1790391757.113399:0:24300:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790391757.113406:0:24300:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790391757.113408:0:24300:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391757.113410:0:24300:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1790391757.113412:0:24300:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790391757.113415:0:24300:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391757.113424:0:24300:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790391757.113429:0:24300:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e52a75c7800 00000020:00000080:1.0:1790391757.113445:0:24300:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790391757.113502:0:24300:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790391757.113506:0:24300:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391757.113507:0:24300:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1790391757.113510:0:24300:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790391757.113513:0:24300:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391757.113514:0:24300:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790391757.113518:0:24300:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e52a75c7800 00000020:00000080:1.0:1790391757.113520:0:24300:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790391757.113538:0:24300:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790391757.113541:0:24300:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391757.113543:0:24300:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790391757.113545:0:24300:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790391757.113548:0:24300:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391757.113549:0:24300:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1790391757.113553:0:24300:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e52a75c7800 00000020:00000080:1.0:1790391757.113555:0:24300:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790391757.113577:0:24300:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790391757.113590:0:24300:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391757.113592:0:24300:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1790391757.113595:0:24300:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1790391757.113791:0:24279:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1790391757.113820:0:24279:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790391757.113842:0:24279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d000/0x2b1b7949f13e2b64 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2b6b expref: -99 pid: 24279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391757.113862:0:24279:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d000/0x2b1b7949f13e2b64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2b6b expref: -99 pid: 24279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391757.113989:0:24279:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790391757.113993:0:24279:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e52a75c7800 10000000:01000000:2.0:1790391757.113996:0:24279:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e52a75c7800 10000000:01000000:2.0:1790391757.114009:0:24279:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790391757.114016:0:24279:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e52a75c7800 from 1 10000000:01000000:2.0:1790391757.114018:0:24279:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790391757.114055:0:24279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e518309c400/0x2b1b7949f13e2b72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391757.114064:0:24279:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e518309c400/0x2b1b7949f13e2b72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391757.114081:0:24279:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e518309c400/0x2b1b7949f13e2b72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391757.114104:0:24279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:24279:1877361186562944:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790391757.114166:0:24279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391757.114205:0:24279:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290bff480 going to sleep for 11 seconds 00000100:00100000:3.0:1790391757.115643:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186562944 00000100:00100000:3.0:1790391757.115659:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186562944 00000100:00100000:3.0:1790391757.115719:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790391757.115730:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282bd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+20:24279:x1877361186562944:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790391757.115746:0:22770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391757.115763:0:22770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52bab9cc00/0x2b1b7949f13e2b79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e2b72 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391757.115789:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52bab9cc00/0x2b1b7949f13e2b79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e2b72 expref: 21 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391757.115801:0:22770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52bab9cc00/0x2b1b7949f13e2b79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2b72 expref: 21 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391757.115809:0:22770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52bab9cc00, rc 0) 00000100:00100000:3.0:1790391757.115907:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282bd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+21:24279:x1877361186562944:12345-0@lo:101:mount.lustre.0 Request processed in 178us (1739us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391757.115913:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790391757.116267:0:24279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:24279:1877361186562944:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790391757.116285:0:24279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e518309c400/0x2b1b7949f13e2b72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2b79 expref: -99 pid: 24279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391757.116295:0:24279:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e518309c400/0x2b1b7949f13e2b72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e2b79 expref: -99 pid: 24279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790391757.119679:0:24279:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1790391757.121639:0:24279:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790391757.121947:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1790391757.121988:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1790391757.122015:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1790391757.122050:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1790391757.122066:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1790391757.122080:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1790391757.122093:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1790391757.122105:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1790391757.122118:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1790391757.122131:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1790391757.122144:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1790391757.122157:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1790391757.122170:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1790391757.122183:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1790391757.122208:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1790391757.122223:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1790391757.122236:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1790391757.122249:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1790391757.122262:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1790391757.122290:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1790391757.122306:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1790391757.122319:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1790391757.122330:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1790391757.122344:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1790391757.122357:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1790391757.122371:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1790391757.122384:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1790391757.122398:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1790391757.122411:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1790391757.122425:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1790391757.122455:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1790391757.122471:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1790391757.122485:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1790391757.122499:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1790391757.122510:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1790391757.122536:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1790391757.122554:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1790391757.122567:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1790391757.122580:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1790391757.122593:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1790391757.122605:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1790391757.122617:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1790391757.122629:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1790391757.122641:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1790391757.122654:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1790391757.122666:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1790391757.122678:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1790391757.122705:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1790391757.122850:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1790391757.122871:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1790391757.122928:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1790391757.122937:0:24279:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1790391757.123057:0:24279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:24279:1877361186563072:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790391757.123130:0:24279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391757.123176:0:24279:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290bffcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391757.126321:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186563072 00000100:00100000:1.0:1790391757.126335:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186563072 00000100:00100000:1.0:1790391757.126398:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1790391757.126408:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282bdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+21:24279:x1877361186563072:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790391757.126612:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282bdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+21:24279:x1877361186563072:12345-0@lo:501:mount.lustre.0 Request processed in 204us (3480us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391757.126620:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1790391757.126675:0:24279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:24279:1877361186563072:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790391757.126744:0:24279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:24279:1877361186563200:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790391757.126795:0:24279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391757.126827:0:24279:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528515d600 going to sleep for 11 seconds 00000100:00100000:1.0:1790391757.126847:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186563200 00000100:00100000:1.0:1790391757.126851:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186563200 00000100:00100000:1.0:1790391757.126871:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1790391757.126894:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282bda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+21:24279:x1877361186563200:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790391757.127221:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282bda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+21:24279:x1877361186563200:12345-0@lo:503:mount.lustre.0 Request processed in 342us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391757.127229:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1790391757.127275:0:24279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:24279:1877361186563200:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790391757.141556:0:24279:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790391757.141954:0:24279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:24279:1877361186563328:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790391757.142135:0:24279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391757.142199:0:24279:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e967300 going to sleep for 11 seconds 00000100:00100000:1.0:1790391757.142241:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186563328 00000100:00100000:1.0:1790391757.142249:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186563328 00000100:00100000:1.0:1790391757.142308:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1790391757.142319:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282bda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+21:24279:x1877361186563328:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790391757.144327:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282bda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+21:24279:x1877361186563328:12345-0@lo:502:mount.lustre.0 Request processed in 2000us (2183us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391757.144341:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1790391757.144723:0:24279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:24279:1877361186563328:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790391757.147201:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1790391757.147254:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1790391757.147270:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1790391757.147285:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1790391757.147299:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1790391757.147312:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1790391757.147326:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1790391757.147340:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1790391757.147353:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1790391757.147366:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1790391757.147379:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1790391757.147391:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1790391757.147403:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1790391757.147417:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1790391757.149072:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1790391757.149141:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1790391757.149158:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1790391757.149171:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1790391757.149183:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1790391757.149197:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1790391757.149212:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1790391757.149225:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1790391757.149239:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1790391757.149253:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1790391757.149268:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1790391757.149303:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1790391757.149319:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1790391757.149332:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1790391757.149344:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1790391757.149356:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1790391757.149367:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1790391757.149393:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1790391757.149405:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1790391757.149418:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1790391757.149431:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1790391757.152235:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1790391757.152257:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1790391757.152271:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1790391757.152285:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1790391757.152300:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1790391757.152314:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1790391757.152348:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1790391757.152362:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1790391757.152373:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1790391757.152385:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1790391757.152397:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1790391757.152412:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1790391757.152426:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1790391757.154279:0:24279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:24279:1877361186563456:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790391757.154376:0:24279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391757.154411:0:24279:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529055d840 going to sleep for 11 seconds 00000100:00100000:2.0:1790391757.155669:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186563456 00000100:00100000:2.0:1790391757.155756:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186563456 00000100:00100000:2.0:1790391757.155821:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790391757.155831:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282bdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+21:24279:x1877361186563456:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790391757.156114:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282bdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+21:24279:x1877361186563456:12345-0@lo:502:mount.lustre.0 Request processed in 284us (1738us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391757.156123:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790391757.156709:0:24279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:24279:1877361186563456:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790391757.157723:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1790391757.157767:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1790391757.157808:0:24279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:24279:1877361186563584:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790391757.157920:0:24279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391757.158562:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186563584 00000100:00100000:2.0:1790391757.158571:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186563584 00000100:00100000:2.0:1790391757.158631:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1790391757.158641:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282bd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+21:24279:x1877361186563584:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790391757.158760:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282bd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+21:24279:x1877361186563584:12345-0@lo:502:mount.lustre.0 Request processed in 120us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391757.158767:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790391757.159472:0:24279:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529055d840 going to sleep for 11 seconds 00000100:00100000:0.0:1790391757.159501:0:24279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:24279:1877361186563584:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790391757.159578:0:24279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1790391757.160067:0:24279:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1790391757.163692:0:24305:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1790391757.163723:0:24305:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9e51823b4d40) 00000020:00000080:2.0:1790391757.163749:0:24305:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1790391757.163851:0:24305:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e52a75c7800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1790391757.163867:0:24305:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e52a75c7800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1790391757.163871:0:24305:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e52a75c7800 3 00010000:00080000:2.0:1790391757.163940:0:24305:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e5182f3c000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.128@tcp at head 00010000:00010000:2.0:1790391757.172869:0:24305:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1790391757.175274:0:24305:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1790391757.175321:0:24305:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790391757.175333:0:24305:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x2b1b7949f13e2b87 00000100:00080000:2.0:1790391757.175345:0:24305:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790391757.175350:0:24305:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e5182f3c000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:2.0:1790391757.175385:0:24305:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e51831dca80 x1877361186563712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790391757.175417:0:24305:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1790391757.176191:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1877361186563712:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790391757.176263:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790391757.176328:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790391757.176333:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790391757.176336:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790391757.176339:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790391757.176343:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790391757.176346:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790391757.176349:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790391757.176352:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790391757.178272:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186563712 00000100:00100000:2.0:1790391757.178285:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186563712 00000100:00100000:2.0:1790391757.178331:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790391757.178339:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bb398380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1877361186563712:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1790391757.178366:0:22777:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 670 last 0 00000020:00000080:2.0:1790391757.178415:0:22777:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x2b1b7949f13e2b8e 00000004:00100000:2.0:1790391757.178444:0:22777:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790391757.178481:0:22777:0:(import.c:65:import_set_state_nolock()) ffff9e5182f3a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790391757.178569:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bb398380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1877361186563712:12345-0@lo:38:llog_process_th.0 Request processed in 229us (2305us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391757.178590:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1790391757.183602:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e51831dca80 x1877361186563712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790391767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391757.183618:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790391757.183629:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1790391757.183647:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1790391757.183653:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790391757.183657:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e5182f3c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790391757.183665:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1877361186563712:0@lo:38:llog_process_th.0 00000020:01000004:2.0:1790391757.186580:0:24305:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1790391757.186600:0:24305:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9e51823b19c0) 00000020:00000080:2.0:1790391757.186626:0:24305:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1790391757.186756:0:24305:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e52a75c7800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1790391757.186761:0:24305:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e52a75c7800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1790391757.186764:0:24305:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e52a75c7800 3 00010000:00080000:2.0:1790391757.186811:0:24305:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e5182f39800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.128@tcp at head 00010000:00010000:2.0:1790391757.188709:0:24305:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1790391757.188978:0:24305:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1790391757.189030:0:24305:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790391757.189041:0:24305:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x2b1b7949f13e2b9c 00000100:00080000:2.0:1790391757.189051:0:24305:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790391757.189056:0:24305:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9e5182f39800 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:2.0:1790391757.189092:0:24305:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e51831ddc00 x1877361186563840/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790391757.189135:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1877361186563840:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790391757.189212:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790391757.189267:0:24305:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1790391757.189283:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790391757.189286:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790391757.189289:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790391757.189291:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790391757.189293:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790391757.189295:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790391757.189297:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790391757.189299:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790391757.189550:0:23840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186563840 00000100:00100000:1.0:1790391757.189557:0:23840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186563840 00000100:00100000:1.0:1790391757.189596:0:23840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790391757.189605:0:23840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3636:x1877361186563840:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1790391757.189656:0:23840:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 670 last 0 00000020:00000080:1.0:1790391757.189707:0:23840:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x2b1b7949f13e2ba3 00000004:00100000:1.0:1790391757.189724:0:23840:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790391757.189763:0:23840:0:(import.c:65:import_set_state_nolock()) ffff9e51833dd800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790391757.189820:0:23840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1877361186563840:12345-0@lo:38:llog_process_th.0 Request processed in 215us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391757.189829:0:23840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1790391757.189874:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e51831ddc00 x1877361186563840/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790391767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391757.189913:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790391757.189922:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1790391757.189928:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1790391757.189932:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1790391757.189933:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e5182f39800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790391757.189938:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1877361186563840:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1790391757.191418:0:24305:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:0.0:1790391757.192176:0:24279:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1790391757.192213:0:24279:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790391757.192235:0:24279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e518309c400/0x2b1b7949f13e2b72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2b79 expref: -99 pid: 24279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391757.192246:0:24279:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e518309c400/0x2b1b7949f13e2b72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2b79 expref: -99 pid: 24279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790391757.192300:0:24279:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790391757.192302:0:24279:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790391757.192304:0:24279:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790391757.192306:0:24279:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790391757.192308:0:24279:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790391757.192310:0:24279:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790391757.192312:0:24279:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790391757.192314:0:24279:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790391757.192316:0:24279:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790391757.192320:0:24279:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1790391757.192323:0:24279:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790391757.192325:0:24279:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790391757.192326:0:24279:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790391757.192327:0:24279:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790391757.192328:0:24279:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790391757.192330:0:24279:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790391757.192331:0:24279:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790391757.192332:0:24279:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790391757.192333:0:24279:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790391757.192358:0:24279:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1790391757.192378:0:24279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:24279:1877361186563968:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790391757.192441:0:24279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391757.192487:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186563968 00000100:00100000:0.0:1790391757.192487:0:24279:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b9bdbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1790391757.192497:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186563968 00000100:00100000:1.0:1790391757.192545:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1790391757.192556:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+21:24279:x1877361186563968:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790391757.192585:0:22770:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1790391757.192601:0:22770:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1790391757.204196:0:22770:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790391757.204223:0:22770:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1790391757.204403:0:22792:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790391757.204408:0:22792:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790391757.204432:0:22792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e518309d600/0x2b1b7949f13e2baa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391757.204452:0:22792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5295144200/0x2b1b7949f13e2af4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2aed expref: 21 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391757.204471:0:22792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5295145200/0x2b1b7949f13e2b02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2afb expref: 21 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391757.204552:0:22792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e518309d600/0x2b1b7949f13e2baa lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391757.204605:0:22792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5295145200/0x2b1b7949f13e2b02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e2afb expref: 21 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391757.204622:0:22792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e5295145200/0x2b1b7949f13e2b02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e2afb expref: 21 pid: 22770 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391757.204638:0:22792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831ddf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22792:1877361186564096:0@lo:104: 00000100:00100000:2.0:1790391757.204800:0:22792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790391757.204866:0:22792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5295144200/0x2b1b7949f13e2af4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e2aed expref: 21 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391757.205406:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+21:24279:x1877361186563968:12345-0@lo:253:mount.lustre.0 Request processed in 12849us (12961us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391757.205432:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1790391757.205689:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186564096 00000100:00100000:3.0:1790391757.205698:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186564096 00000100:00100000:3.0:1790391757.205738:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790391757.205747:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e907dcd1-fffe-43bb-853f-376b925bb229+3:22792:x1877361186564096:12345-0@lo:104: 00010000:00010000:3.0:1790391757.205771:0:22759:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e2afb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e2b02 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391757.205822:0:22759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790391757.205828:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e907dcd1-fffe-43bb-853f-376b925bb229+3:22792:x1877361186564096:12345-0@lo:104: Request processed in 83us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391757.205835:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1790391757.206226:0:22792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e5295144200/0x2b1b7949f13e2af4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e2aed expref: 20 pid: 22769 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391757.206239:0:22792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831ddc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22792:1877361186564224:0@lo:104: 00000100:00100000:2.0:1790391757.206279:0:22792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391757.206311:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290bffe40 going to sleep for 11 seconds 00000100:00100000:2.0:1790391757.206331:0:22792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831ddf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22792:1877361186564096:0@lo:104: 00000100:00100000:2.0:1790391757.206368:0:22759:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790391757.206377:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186564224 00000100:00100000:2.0:1790391757.206380:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186564224 00000100:00100000:2.0:1790391757.206409:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790391757.206424:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52aeeb2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e907dcd1-fffe-43bb-853f-376b925bb229+3:22792:x1877361186564224:12345-0@lo:104: 00010000:00010000:2.0:1790391757.206435:0:22759:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d400/0x2b1b7949f13e2aed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e2af4 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391757.206637:0:24279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:24279:1877361186563968:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790391757.206650:0:24279:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1790391757.206653:0:24279:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790391757.206655:0:24279:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790391757.206656:0:24279:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790391757.206658:0:24279:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790391757.206659:0:24279:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790391757.206660:0:24279:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790391757.206662:0:24279:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790391757.206664:0:24279:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790391757.206666:0:24279:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790391757.206682:0:24279:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1790391757.207805:0:22759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790391757.207819:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52aeeb2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e907dcd1-fffe-43bb-853f-376b925bb229+3:22792:x1877361186564224:12345-0@lo:104: Request processed in 1393us (1537us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391757.207829:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1790391757.207918:0:22764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790391757.207926:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e2afb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e2b02 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391757.207935:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295144600 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:2.0:1790391757.207940:0:22764:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e2afb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e2b02 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391757.207950:0:22764:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e2afb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e2b02 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790391757.207958:0:22764:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e2afb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e2b02 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391757.208709:0:22764:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790391757.208761:0:22764:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e2afb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e2b02 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391757.208770:0:22764:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790391757.208798:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e2afb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e2b02 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391757.208818:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e2afb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e2b02 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391757.208835:0:22764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391757.208840:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d400/0x2b1b7949f13e2aed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e2af4 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391757.208846:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52bab9d400 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:2.0:1790391757.208850:0:22764:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d400/0x2b1b7949f13e2aed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e2af4 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391757.209701:0:22764:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d400/0x2b1b7949f13e2aed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e2af4 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790391757.209714:0:22764:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d400/0x2b1b7949f13e2aed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e2af4 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391757.209720:0:22764:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790391757.209749:0:22764:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d400/0x2b1b7949f13e2aed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e2af4 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391757.209756:0:22764:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790391757.209782:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d400/0x2b1b7949f13e2aed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e2af4 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391757.209789:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d400/0x2b1b7949f13e2aed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e2af4 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391757.209808:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391757.209816:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391757.209819:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391757.209850:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e907dcd1-fffe-43bb-853f-376b925bb229:3638:1877361186564352:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790391757.210751:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391757.211233:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391757.211435:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186564352 00000100:00100000:2.0:1790391757.211443:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186564352 00010000:00010000:2.0:1790391757.211473:0:22763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5295145200/0x2b1b7949f13e2b02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e2afb expref: 21 pid: 22770 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391757.211520:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790391757.211529:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e907dcd1-fffe-43bb-853f-376b925bb229+21:3638:x1877361186564352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790391757.211541:0:22763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391757.211547:0:22763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5295145200/0x2b1b7949f13e2b02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e2afb expref: 21 pid: 22770 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391757.211560:0:22763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5295145200/0x2b1b7949f13e2b02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e2afb expref: 21 pid: 22770 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391757.211587:0:22763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5295145200/0x2b1b7949f13e2b02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e2afb expref: 21 pid: 22770 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391757.211602:0:22763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391757.211639:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e907dcd1-fffe-43bb-853f-376b925bb229+20:3638:x1877361186564352:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391757.211646:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790391757.211693:0:22792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831ddc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22792:1877361186564224:0@lo:104: 00010000:00010000:2.0:1790391757.211715:0:22792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e518309d600/0x2b1b7949f13e2baa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391757.211737:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e907dcd1-fffe-43bb-853f-376b925bb229:3638:1877361186564352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790391757.212414:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e907dcd1-fffe-43bb-853f-376b925bb229:3639:1877361186564480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790391757.212524:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391757.212664:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186564480 00000100:00100000:0.0:1790391757.212672:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186564480 00010000:00010000:0.0:1790391757.212696:0:22762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5295144200/0x2b1b7949f13e2af4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e2aed expref: 20 pid: 22769 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391757.212737:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790391757.212746:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e907dcd1-fffe-43bb-853f-376b925bb229+20:3639:x1877361186564480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790391757.212756:0:22762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391757.212761:0:22762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5295144200/0x2b1b7949f13e2af4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e2aed expref: 20 pid: 22769 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391757.212773:0:22762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5295144200/0x2b1b7949f13e2af4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e2aed expref: 20 pid: 22769 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391757.212788:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5295144200/0x2b1b7949f13e2af4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e2aed expref: 20 pid: 22769 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391757.212813:0:22762:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e518309d600/0x2b1b7949f13e2baa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391757.212821:0:22762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e518309d600/0x2b1b7949f13e2baa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790391757.212837:0:22762:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013940840s 00010000:00010000:0.0:1790391757.212842:0:22762:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e518309d600/0x2b1b7949f13e2baa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391757.212848:0:22762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e518309d600/0x2b1b7949f13e2baa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391757.212865:0:22762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e518309d600/0x2b1b7949f13e2baa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391757.213740:0:22762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e518309d600/0x2b1b7949f13e2baa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391757.213747:0:22762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309d600 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:0.0:1790391757.213752:0:22762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e518309d600/0x2b1b7949f13e2baa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391757.213762:0:22762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e518309d600/0x2b1b7949f13e2baa lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391757.213782:0:22762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e518309d600/0x2b1b7949f13e2baa lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391757.213794:0:22762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790391757.213804:0:22792:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e518309d600/0x2b1b7949f13e2baa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391757.213816:0:22792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e518309d600/0x2b1b7949f13e2baa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391757.213823:0:22792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e518309d600/0x2b1b7949f13e2baa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391757.214822:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e907dcd1-fffe-43bb-853f-376b925bb229+19:3639:x1877361186564480:12345-0@lo:103:ldlm_bl.0 Request processed in 2072us (2293us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391757.214833:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790391757.216437:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e907dcd1-fffe-43bb-853f-376b925bb229:3639:1877361186564480:0@lo:103:ldlm_bl.0 00000001:00000004:0.0:1790391757.216530:0:24279:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1790391757.221790:0:24279:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1790391757.221800:0:24279:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1790391757.221838:0:24279:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1790391757.221918:0:24279:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.128@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1790391757.221938:0:24279:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1790391757.221958:0:24279:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1790391757.222996:0:24279:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790391757.225014:0:24279:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790391757.640502:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1790391758.162272:0:24360:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790391758.162599:0:24360:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1790391758.352610:0:22773:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790391758.352621:0:22773:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e5284985000 from 13 10000000:01000000:0.0:1790391758.352628:0:22773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790391758.352976:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e2bb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391758.352997:0:22773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e2bb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391758.353009:0:22773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e2bb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391758.353039:0:22773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186564608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790391758.354235:0:22773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391758.354290:0:22773:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528820d840 going to sleep for 11 seconds 00000100:00100000:3.0:1790391758.354676:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186564608 00000100:00100000:3.0:1790391758.354687:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186564608 00000100:00100000:3.0:1790391758.354745:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1790391758.354755:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+19:22773:x1877361186564608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391758.354769:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391758.354788:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52bab9de00/0x2b1b7949f13e2bb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e2bb1 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391758.354815:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52bab9de00/0x2b1b7949f13e2bb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e2bb1 expref: 20 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391758.354826:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52bab9de00/0x2b1b7949f13e2bb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2bb1 expref: 20 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391758.354847:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52bab9de00, rc 0) 00000100:00100000:0.0:1790391758.354998:0:22773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186564608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790391758.355015:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e2bb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2bb8 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391758.355037:0:22773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e2bb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e2bb8 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391758.355115:0:22773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186564736:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790391758.355154:0:22773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391758.355176:0:22773:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528820d840 going to sleep for 11 seconds 00000100:00100000:0.0:1790391758.355189:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186564736 00000100:00100000:0.0:1790391758.355192:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186564736 00000100:00100000:0.0:1790391758.355219:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790391758.355226:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+21:22773:x1877361186564736:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1790391758.355240:0:22770:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790391758.355256:0:22770:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790391758.355260:0:22770:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1790391758.355331:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+21:22773:x1877361186564736:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 105us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391758.355339:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790391758.355378:0:22773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186564736:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1790391758.355643:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+20:22773:x1877361186564608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391758.355649:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 10000000:01000000:0.0:1790391758.357798:0:22773:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790391758.357817:0:22773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e2bb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2bb8 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391758.357829:0:22773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e2bb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2bb8 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391758.357839:0:22773:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790391758.357841:0:22773:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e52b56dd000 from 13 10000000:01000000:0.0:1790391758.357849:0:22773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790391758.358175:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295144800/0x2b1b7949f13e2bbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391758.358185:0:22773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e5295144800/0x2b1b7949f13e2bbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391758.358196:0:22773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e5295144800/0x2b1b7949f13e2bbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391758.358221:0:22773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186564864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790391758.358284:0:22773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391758.358442:0:22773:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528820d840 going to sleep for 11 seconds 00000100:00100000:2.0:1790391758.375246:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186564864 00000100:00100000:2.0:1790391758.375260:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186564864 00000100:00100000:2.0:1790391758.377173:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1790391758.377188:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+20:22773:x1877361186564864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790391758.377210:0:22769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391758.377231:0:22769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e518309cc00/0x2b1b7949f13e2bc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e2bbf expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391758.377267:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e518309cc00/0x2b1b7949f13e2bc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e2bbf expref: 21 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391758.377278:0:22769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e518309cc00/0x2b1b7949f13e2bc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2bbf expref: 21 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391758.377287:0:22769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309cc00, rc 0) 00000100:00100000:2.0:1790391758.377369:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+21:22773:x1877361186564864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (19084us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391758.377376:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1790391758.377452:0:22773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186564864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790391758.377471:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e5295144800/0x2b1b7949f13e2bbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2bc6 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391758.377481:0:22773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e5295144800/0x2b1b7949f13e2bbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e2bc6 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391758.377550:0:22773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186564992:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1790391758.377598:0:22773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391758.377637:0:22773:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290bffe40 going to sleep for 11 seconds 00000100:00100000:2.0:1790391758.377652:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186564992 00000100:00100000:2.0:1790391758.377658:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186564992 00000100:00100000:2.0:1790391758.377690:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1790391758.377697:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+21:22773:x1877361186564992:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790391758.377712:0:22770:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790391758.377726:0:22770:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790391758.377729:0:22770:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1790391758.377815:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+21:22773:x1877361186564992:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 118us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391758.377819:0:22773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186564992:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1790391758.377823:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 10000000:01000000:3.0:1790391758.377902:0:22773:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790391758.377909:0:22773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295144800/0x2b1b7949f13e2bbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2bc6 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391758.377918:0:22773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5295144800/0x2b1b7949f13e2bbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2bc6 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391758.665464:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391759.693222:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391760.714360:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391761.416110:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186565120:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790391761.416227:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391761.416336:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186565120 00000100:00100000:1.0:1790391761.416348:0:22781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186565120 00000100:00100000:1.0:1790391761.416421:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790391761.416434:0:22781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bb39a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186565120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790391761.416482:0:22781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1790391761.416673:0:22781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bb39a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186565120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391761.416683:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790391761.416850:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186565120:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1790391761.736472:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391761.928355:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790391761.934846:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186565248:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790391761.934949:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391761.935120:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186565248 00000100:00100000:3.0:1790391761.935128:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186565248 00000100:00100000:3.0:1790391761.935196:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790391761.935206:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186565248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790391761.935245:0:22782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1790391761.935297:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186565248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391761.935304:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790391761.935448:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186565248:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1790391762.444073:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790391762.444085:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790391762.444087:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790391762.444090:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790391762.444117:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790391762.444121:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790391762.444124:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790391762.444127:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790391762.444213:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e907dcd1-fffe-43bb-853f-376b925bb229:3638:1877361186565376:0@lo:400:kworker.0 00000100:00100000:2.0:1790391762.444304:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391762.444347:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1877361186565888:0@lo:400:kworker.0 00000100:00100000:2.0:1790391762.444382:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391762.444409:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790391762.444415:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877361186565760:0@lo:400:kworker.0 00000100:00100000:2.0:1790391762.445170:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391762.445214:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877361186565504:0@lo:400:kworker.0 00000100:00100000:2.0:1790391762.445238:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391762.445254:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1877361186566016:0@lo:400:kworker.0 00000100:00100000:2.0:1790391762.445272:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391762.445291:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790391762.445296:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186565632:0@lo:400:kworker.0 00000100:00100000:2.0:1790391762.445316:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391762.445348:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186565376 00000100:00100000:2.0:1790391762.445355:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186565376 00000100:00100000:2.0:1790391762.445398:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1790391762.445406:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+21:3638:x1877361186565376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391762.448119:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+21:3638:x1877361186565376:12345-0@lo:400:kworker.0 Request processed in 2704us (3806us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391762.448138:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1790391762.448212:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186565888 00000100:00100000:2.0:1790391762.448220:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186565888 00000100:00100000:2.0:1790391762.448265:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186565760 00000100:00100000:2.0:1790391762.448268:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186565760 00000100:00100000:2.0:1790391762.448281:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186565504 00000100:00100000:2.0:1790391762.448284:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186565504 00000100:00100000:2.0:1790391762.448295:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186566016 00000100:00100000:2.0:1790391762.448312:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186566016 00000100:00100000:2.0:1790391762.448333:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790391762.448340:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877361186565888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391762.448387:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877361186565888:12345-0@lo:400:kworker.0 Request processed in 48us (4004us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391762.448394:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790391762.448406:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790391762.448412:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877361186565760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391762.448439:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877361186565760:12345-0@lo:400:kworker.0 Request processed in 27us (3272us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391762.448445:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790391762.448456:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790391762.448461:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877361186565504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391762.448493:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877361186565504:12345-0@lo:400:kworker.0 Request processed in 31us (3253us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391762.448498:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790391762.448509:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790391762.448514:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288345180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877361186566016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391762.448541:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288345180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877361186566016:12345-0@lo:400:kworker.0 Request processed in 27us (3268us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391762.448547:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790391762.448576:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186565632 00000100:00100000:2.0:1790391762.448580:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186565632 00000100:00100000:2.0:1790391762.448607:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790391762.448613:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186565632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391762.448643:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186565632:12345-0@lo:400:kworker.0 Request processed in 30us (3326us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391762.448655:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1790391762.448684:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790391762.448688:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790391762.448721:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186565632:0@lo:400:kworker.0 00010000:00080000:2.0:1790391762.448737:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e51831ddf80 x1877361186565504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391762.448748:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877361186565504:0@lo:400:kworker.0 00010000:00080000:2.0:1790391762.448758:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e51831dce00 x1877361186566016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391762.448766:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1877361186566016:0@lo:400:kworker.0 00010000:00080000:2.0:1790391762.448803:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e51831dd180 x1877361186565760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391762.448812:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877361186565760:0@lo:400:kworker.0 00000100:00100000:2.0:1790391762.448821:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e907dcd1-fffe-43bb-853f-376b925bb229:3638:1877361186565376:0@lo:400:kworker.0 00010000:00080000:2.0:1790391762.448830:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e51831df100 x1877361186565888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391762.448839:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1877361186565888:0@lo:400:kworker.0 00010000:00010000:1.0:1790391762.763681:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790391763.663174:0:23532:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790391763.789104:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790391764.279776:0:24651:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg228-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:0.0:1790391764.564343:0:22810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790391764.809082:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1790391765.321532:0:24703:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790391765.321776:0:24703:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790391765.832056:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1790391766.181484:0:24754:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790391766.181807:0:24754:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1790391766.408024:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790391751/real 1790391751] req@ffff9e51831dc380 x1877361186560128/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391766 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391766.408116:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e51831dc380 x1877361186560128/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391766 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391766.408151:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790391751/real 1790391751] req@ffff9e51831dd500 x1877361186560256/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391766 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391766.408166:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e51831dd500 x1877361186560256/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391766 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790391766.408186:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e52b75c1000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790391766.408211:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790391766.408216:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186560128:0@lo:8:kworker.0 00000100:00080000:2.0:1790391766.408222:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e52b5cbb800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790391766.408227:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790391766.408230:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186560256:0@lo:8:kworker.0 00000100:00080000:1.0:1790391766.409033:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790391766.409040:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790391766.409043:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790391766.409046:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790391766.409064:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790391766.409068:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1790391766.409071:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e52b75c1000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790391766.409078:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 665 00000100:00080000:1.0:1790391766.409085:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1790391766.409093:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9e52b75c1000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:1.0:1790391766.409115:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e518331f800 x1877361186566656/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790391766.409146:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790391766.409150:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1790391766.409152:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e52b5cbb800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790391766.409156:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 665 00000100:00080000:1.0:1790391766.409158:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1790391766.409161:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e52b5cbb800 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:1.0:1790391766.409175:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e518331e680 x1877361186566784/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790391766.409221:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186566656:0@lo:8:kworker.0 00000100:00100000:1.0:1790391766.409287:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391766.409339:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186566784:0@lo:8:kworker.0 00000100:00100000:1.0:1790391766.409361:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391766.411956:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e907dcd1-fffe-43bb-853f-376b925bb229:3640:1877361186566144:0@lo:400:kworker.0 00000100:00100000:2.0:1790391766.412038:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391766.412097:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877361186566912:0@lo:400:kworker.0 00000100:00100000:2.0:1790391766.412127:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391766.412157:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790391766.412163:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186566528:0@lo:400:kworker.0 00000100:00100000:2.0:1790391766.412189:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391766.412221:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877361186566400:0@lo:400:kworker.0 00000100:00100000:2.0:1790391766.412245:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391766.412264:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1877361186567168:0@lo:400:kworker.0 00000100:00100000:2.0:1790391766.412284:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391766.412301:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1790391766.412307:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186566272:0@lo:400:kworker.0 00000100:00100000:2.0:1790391766.412345:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391766.412363:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1877361186567040:0@lo:400:kworker.0 00000100:00100000:2.0:1790391766.412383:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391766.412421:0:24285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186566656 00000100:00100000:2.0:1790391766.412429:0:24285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186566656 00000100:00100000:2.0:1790391766.412462:0:24285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186566784 00000100:00100000:1.0:1790391766.412465:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186566144 00000100:00100000:2.0:1790391766.412466:0:24285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186566784 00000100:00100000:1.0:1790391766.412472:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186566144 00000100:00100000:2.0:1790391766.412485:0:24285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790391766.412517:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1790391766.412525:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+21:3640:x1877361186566144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391766.412585:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+21:3640:x1877361186566144:12345-0@lo:400:kworker.0 Request processed in 60us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391766.412592:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1790391766.412756:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e907dcd1-fffe-43bb-853f-376b925bb229:3640:1877361186566144:0@lo:400:kworker.0 00000100:00100000:2.0:1790391766.412991:0:24285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3636:x1877361186566656:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1790391766.413020:0:24285:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 679 last 0 00000020:00000080:2.0:1790391766.413047:0:24285:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2b1b7949f13e2bcd 00002000:00100000:2.0:1790391766.413062:0:24285:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9e5182f3b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1790391766.413067:0:24285:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1790391766.413071:0:24285:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1790391766.413259:0:24285:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1790391766.413283:0:24285:0:(import.c:65:import_set_state_nolock()) ffff9e5182f38000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790391766.413341:0:24285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3636:x1877361186566656:12345-0@lo:8:kworker.0 Request processed in 847us (4053us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391766.413349:0:24285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790391766.413366:0:24285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790391766.413371:0:24285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3636:x1877361186566784:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1790391766.413382:0:24285:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1790391766.413739:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186566912 00000100:00100000:3.0:1790391766.413746:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186566912 00000100:00100000:3.0:1790391766.413773:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186566400 00000100:00100000:3.0:1790391766.413776:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186566400 00000100:00100000:3.0:1790391766.413788:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186567168 00000100:00100000:3.0:1790391766.413791:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186567168 00000100:00100000:3.0:1790391766.413814:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186567040 00000100:00100000:3.0:1790391766.413817:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186567040 00000100:00100000:3.0:1790391766.413830:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790391766.413837:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288346a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877361186566912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391766.413901:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288346a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877361186566912:12345-0@lo:400:kworker.0 Request processed in 64us (1773us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391766.413907:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790391766.413931:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790391766.413937:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288345f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877361186566400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391766.413995:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288345f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877361186566400:12345-0@lo:400:kworker.0 Request processed in 56us (1747us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391766.414001:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790391766.414018:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790391766.414026:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288344380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877361186567168:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1790391766.414045:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e518331c380 x1877361186566912/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391766.414056:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288344380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877361186567168:12345-0@lo:400:kworker.0 Request processed in 30us (1769us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391766.414062:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790391766.414075:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877361186566912:0@lo:400:kworker.0 00000100:00100000:3.0:1790391766.414079:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790391766.414088:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288347b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877361186567040:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1790391766.414133:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e518331f800 x1877361186566656/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790391786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391766.414143:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790391766.414151:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1790391766.414159:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1790391766.414165:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790391766.414166:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1790391766.414171:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e52b75c1000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1790391766.414172:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1790391766.414193:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1790391766.414199:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186566656:0@lo:8:kworker.0 00000004:00080000:0.0:1790391766.414227:0:23519:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1790391766.414242:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790391766.414251:0:23519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23519:1877361186567424:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1790391766.414255:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186567296:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790391766.418078:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288347b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877361186567040:12345-0@lo:400:kworker.0 Request processed in 3981us (5683us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391766.418114:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790391766.418170:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186566528 00000100:00100000:3.0:1790391766.418180:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186566528 00000100:00100000:3.0:1790391766.418231:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186566272 00000100:00100000:3.0:1790391766.418234:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186566272 00000100:00100000:3.0:1790391766.418337:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790391766.418347:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186566528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391766.418456:0:23519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391766.418507:0:23519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528836e480 going to sleep for 11 seconds 00000100:00100000:0.0:1790391766.418535:0:24284:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1790391766.418543:0:24284:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1790391766.418680:0:24284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186567424 00000100:00100000:1.0:1790391766.419455:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391766.420176:0:24284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186567424 00000100:00080000:1.0:1790391766.420276:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790391766.420367:0:24766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790391766.420378:0:24766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23519:x1877361186567424:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1790391766.421039:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186566528:12345-0@lo:400:kworker.0 Request processed in 2691us (8845us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391766.421051:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790391766.421076:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790391766.421087:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288345500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186566272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391766.421087:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186566528:0@lo:400:kworker.0 00000100:00100000:3.0:1790391766.421138:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288345500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186566272:12345-0@lo:400:kworker.0 Request processed in 55us (8792us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391766.421144:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:3.0:1790391766.421169:0:23518:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1790391766.421254:0:23518:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 679788376728ns, next at 0ns, rc = 0 00080000:00080000:3.0:1790391766.421260:0:23518:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1790391766.421296:0:24287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186567296 00000100:00100000:3.0:1790391766.421302:0:24287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186567296 00000100:00100000:3.0:1790391766.421337:0:24287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790391766.421344:0:24287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3640:x1877361186567296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790391766.421364:0:24287:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1790391766.421405:0:24287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3640:x1877361186567296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (1952us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391766.421411:0:24287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790391766.421490:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186566272:0@lo:400:kworker.0 00010000:00080000:1.0:1790391766.421499:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e51838f7100 x1877361186567296/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391782 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391766.421517:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186567296:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1790391766.423190:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e51820aed80 x1877361186567040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391766.423205:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1877361186567040:0@lo:400:kworker.0 00010000:00080000:3.0:1790391766.423218:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e518331dc00 x1877361186566400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391766.423226:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877361186566400:0@lo:400:kworker.0 00010000:00080000:3.0:1790391766.423243:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e51820afb80 x1877361186567168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391766.423251:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1877361186567168:0@lo:400:kworker.0 00000004:00080000:0.0:1790391766.428802:0:23510:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:0.0:1790391766.440243:0:24766:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1790391766.440261:0:24766:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1790391766.440422:0:24766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23519:x1877361186567424:12345-0@lo:7:osp-pre-0-1.0 Request processed in 20040us (21959us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391766.440435:0:24766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1790391766.440574:0:23519:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e51838f6680 x1877361186567424/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790391782 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391766.440607:0:23519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23519:1877361186567424:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1790391766.440624:0:23519:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:3.0:1790391766.440953:0:23519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb398700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23519:1877361186567552:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1790391766.441014:0:23519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391766.441046:0:23519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52ae87dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1790391766.442686:0:24285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3636:x1877361186566784:12345-0@lo:8:kworker.0 Request processed in 29308us (33318us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790391766.442699:0:24285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790391766.442730:0:24285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186567552 00000100:00100000:2.0:1790391766.442753:0:24285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186567552 00000100:00100000:2.0:1790391766.442826:0:24286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790391766.442836:0:24286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bb39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23519:x1877361186567552:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1790391766.442868:0:24286:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:2.0:1790391766.442979:0:24286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bb39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23519:x1877361186567552:12345-0@lo:5:osp-pre-0-1.0 Request processed in 144us (1964us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391766.442986:0:24286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1790391766.443041:0:23519:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e52bb398700 x1877361186567552/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790391782 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391766.443068:0:23519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb398700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23519:1877361186567552:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1790391766.443081:0:23519:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1790391766.443121:0:23519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288344700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23519:1877361186567680:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1790391766.443152:0:23519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391766.443171:0:23519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290b46240 going to sleep for 11 seconds 00000100:00100000:2.0:1790391766.443186:0:24285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186567680 00000100:00100000:2.0:1790391766.443190:0:24285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186567680 00000100:00100000:2.0:1790391766.443219:0:24284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790391766.443226:0:24284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288347480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23519:x1877361186567680:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1790391766.443254:0:24284:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00080000:3.0:1790391766.451283:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e52b5cbb800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790391766.451299:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790391766.451304:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186566784:0@lo:8:kworker.0 00000001:00080000:2.0:1790391766.484744:0:24280:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:2.0:1790391766.484768:0:24280:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1790391766.485271:0:24284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288347480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:23519:x1877361186567680:12345-0@lo:5:osp-pre-0-1.0 Request processed in 42034us (42107us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1790391766.485347:0:24284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1790391766.485404:0:23519:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5288344700 x1877361186567680/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790391782 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391766.485421:0:23519:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1790391766.485431:0:23519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288344700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23519:1877361186567680:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1790391766.485468:0:23519:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:2.0:1790391766.485616:0:23519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288344700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23519:1877361186567808:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1790391766.485678:0:23519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391766.485870:0:23519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290b46240 going to sleep for 11 seconds 00000100:00100000:3.0:1790391766.487018:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186567808 00000100:00100000:3.0:1790391766.487041:0:22787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186567808 00000100:00100000:3.0:1790391766.487103:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790391766.487113:0:22787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288346d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23519:x1877361186567808:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1790391766.487203:0:22787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288346d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23519:x1877361186567808:12345-0@lo:900:osp-pre-0-1.0 Request processed in 92us (1525us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391766.487210:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790391766.487976:0:23519:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5288344700 x1877361186567808/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790391782 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391766.488011:0:23519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288344700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23519:1877361186567808:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1790391766.537084:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186567936:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790391766.537164:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391766.543071:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186567936 00000100:00100000:3.0:1790391766.543092:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186567936 00000100:00100000:3.0:1790391766.543162:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790391766.543176:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bb399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186567936:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790391766.543221:0:22782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1790391766.543322:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bb399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186567936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 150us (6158us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391766.543330:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790391766.543727:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186567936:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1790391766.856123:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391767.049067:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186568064:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790391767.049127:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391767.049206:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186568064 00000100:00100000:2.0:1790391767.049214:0:22781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186568064 00000100:00100000:2.0:1790391767.049260:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790391767.049267:0:22781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bb39b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186568064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790391767.049295:0:22781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790391767.049336:0:22781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bb39b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186568064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391767.049342:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790391767.049420:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186568064:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790391767.431981:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790391747/real 1790391747] req@ffff9e51820ac700 x1877361186557568/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391767 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391767.432014:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e51820ac700 x1877361186557568/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391767 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391767.432025:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790391747/real 1790391747] req@ffff9e51820af800 x1877361186557696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391767 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391767.432060:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e51820af800 x1877361186557696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391767 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790391767.432082:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e528493f000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790391767.432113:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790391767.432118:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186557568:0@lo:8:kworker.0 00000100:00080000:3.0:1790391767.432124:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e528493c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790391767.432138:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790391767.432141:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186557696:0@lo:8:kworker.0 00000100:00080000:0.0:1790391767.432283:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790391767.432288:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1790391767.432290:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e528493f000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790391767.432296:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 660 00000100:00080000:0.0:1790391767.432302:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1790391767.432309:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e528493f000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:0.0:1790391767.432330:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e51838f6680 x1877361186568320/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790391767.432350:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790391767.432353:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790391767.432355:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e528493c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790391767.432358:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 660 00000100:00080000:0.0:1790391767.432361:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1790391767.432364:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e528493c000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:0.0:1790391767.432375:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e51838f7100 x1877361186568448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790391767.432420:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790391767.432431:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790391767.432433:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e52b5cbb800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790391767.432437:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 679 00000100:00080000:0.0:1790391767.432440:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1790391767.432443:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e52b5cbb800 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:0.0:1790391767.432454:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e51838f5f80 x1877361186568960/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790391767.432513:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877361186568576:0@lo:400:kworker.0 00000100:00100000:0.0:1790391767.432576:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391767.432605:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183baaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1877361186569216:0@lo:400:kworker.0 00000100:00100000:0.0:1790391767.432630:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391767.432646:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1790391767.432652:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186568704:0@lo:400:kworker.0 00000100:00100000:0.0:1790391767.432678:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391767.432697:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183ba9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1877361186569344:0@lo:400:kworker.0 00000100:00100000:0.0:1790391767.432718:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391767.432743:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186568576 00000100:00100000:0.0:1790391767.432750:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186568576 00000100:00100000:0.0:1790391767.432787:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186569216 00000100:00100000:0.0:1790391767.432790:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186569216 00000100:00100000:0.0:1790391767.432802:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186569344 00000100:00100000:0.0:1790391767.432804:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186569344 00000100:00100000:0.0:1790391767.432817:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790391767.432825:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183ba8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877361186568576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391767.432872:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183ba8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877361186568576:12345-0@lo:400:kworker.0 Request processed in 47us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391767.432930:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790391767.432949:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790391767.432955:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877361186569216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391767.432986:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877361186569216:12345-0@lo:400:kworker.0 Request processed in 31us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391767.432992:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790391767.433003:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790391767.433008:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183ba9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877361186569344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391767.433032:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183ba9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877361186569344:12345-0@lo:400:kworker.0 Request processed in 24us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391767.433037:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790391767.433055:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186568704 00000100:00100000:0.0:1790391767.433059:0:22781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186568704 00000100:00100000:0.0:1790391767.433083:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790391767.433089:0:22781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183baad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186568704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391767.433119:0:22781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183baad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186568704:12345-0@lo:400:kworker.0 Request processed in 30us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391767.433125:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790391767.433158:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186568704:0@lo:400:kworker.0 00010000:00080000:0.0:1790391767.433169:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5183ba9500 x1877361186569344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391767.433177:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183ba9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1877361186569344:0@lo:400:kworker.0 00010000:00080000:0.0:1790391767.433185:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e51838f7480 x1877361186568576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391767.433203:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877361186568576:0@lo:400:kworker.0 00010000:00080000:0.0:1790391767.433213:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5183baaa00 x1877361186569216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391767.433220:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183baaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1877361186569216:0@lo:400:kworker.0 00000100:00100000:1.0:1790391767.433302:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186568832:0@lo:400:kworker.0 00000100:00100000:1.0:1790391767.433334:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391767.433362:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790391767.433368:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e907dcd1-fffe-43bb-853f-376b925bb229:3637:1877361186568192:0@lo:400:kworker.0 00000100:00100000:1.0:1790391767.433391:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391767.433425:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186569088:0@lo:400:kworker.0 00000100:00100000:1.0:1790391767.433448:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391767.433475:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186568192 00000100:00100000:1.0:1790391767.433478:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186568192 00000100:00100000:1.0:1790391767.433503:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1790391767.433508:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+21:3637:x1877361186568192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391767.433538:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+21:3637:x1877361186568192:12345-0@lo:400:kworker.0 Request processed in 30us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391767.433544:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1790391767.433575:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e907dcd1-fffe-43bb-853f-376b925bb229:3637:1877361186568192:0@lo:400:kworker.0 00000100:00100000:1.0:1790391767.433589:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186569088 00000100:00100000:1.0:1790391767.433591:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186569088 00000100:00100000:1.0:1790391767.433606:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790391767.433611:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186569088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391767.433640:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186569088:12345-0@lo:400:kworker.0 Request processed in 29us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391767.433646:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1790391767.433668:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e51838f5c00 x1877361186569088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391767.433676:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186569088:0@lo:400:kworker.0 00000100:00100000:2.0:1790391767.434027:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186568320:0@lo:8:kworker.0 00000100:00100000:2.0:1790391767.434062:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391767.434084:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186568448:0@lo:8:kworker.0 00000100:00100000:2.0:1790391767.434104:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391767.434117:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186568960:0@lo:8:kworker.0 00000100:00100000:2.0:1790391767.434135:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391767.434225:0:24284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186568832 00000100:00100000:3.0:1790391767.434230:0:24284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186568832 00000100:00100000:3.0:1790391767.434254:0:24284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186568320 00000100:00100000:3.0:1790391767.434257:0:24284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186568320 00000100:00100000:3.0:1790391767.434265:0:24284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186568448 00000100:00100000:3.0:1790391767.434268:0:24284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186568448 00000100:00100000:3.0:1790391767.434274:0:24284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186568960 00000100:00100000:3.0:1790391767.434276:0:24284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186568960 00000100:00100000:3.0:1790391767.434284:0:24284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790391767.434290:0:24284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186568832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391767.434339:0:24284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186568832:12345-0@lo:400:kworker.0 Request processed in 49us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391767.434346:0:24284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790391767.434359:0:24284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790391767.434363:0:24284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288344e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1877361186568320:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1790391767.434395:0:24284:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 680 last 0 00000020:00000080:3.0:1790391767.434428:0:24284:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2b1b7949f13e2bd4 00002000:00100000:3.0:1790391767.434450:0:24284:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9e5181cc6800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1790391767.434454:0:24284:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1790391767.434457:0:24284:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1790391767.434539:0:24284:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790391767.434564:0:24284:0:(import.c:65:import_set_state_nolock()) ffff9e5183333800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790391767.434603:0:24284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288344e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1877361186568320:12345-0@lo:8:kworker.0 Request processed in 238us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391767.434609:0:24284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790391767.434621:0:24284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790391767.434625:0:24284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288346300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1877361186568448:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1790391767.434636:0:24284:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1790391767.434661:0:24284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288346300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1877361186568448:12345-0@lo:8:kworker.0 Request processed in 34us (556us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790391767.434666:0:24284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790391767.434676:0:24284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790391767.434680:0:24284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288347800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1877361186568960:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1790391767.434688:0:24284:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1790391767.434712:0:24284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288347800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1877361186568960:12345-0@lo:8:kworker.0 Request processed in 31us (576us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790391767.434717:0:24284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1790391767.434752:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e51838f6680 x1877361186568320/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790391792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391767.434761:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790391767.434768:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1790391767.434775:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1790391767.434787:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1790391767.434790:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e528493f000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1790391767.434801:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1790391767.434807:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186568320:0@lo:8:kworker.0 00000100:00080000:3.0:1790391767.434823:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e528493c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790391767.434826:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790391767.434829:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186568448:0@lo:8:kworker.0 00000100:00080000:3.0:1790391767.434837:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e52b5cbb800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790391767.434840:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790391767.434843:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186568960:0@lo:8:kworker.0 00000004:00080000:2.0:1790391767.434990:0:22800:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790391767.435063:0:22800:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 680802185479ns, next at 0ns, rc = 0 00080000:00080000:2.0:1790391767.435070:0:22800:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00080000:2.0:1790391767.435110:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e51838f7800 x1877361186568832/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391767.435125:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186568832:0@lo:400:kworker.0 00000004:00080000:1.0:1790391767.435528:0:22801:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00000100:00100000:1.0:1790391767.435550:0:22801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820af800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22801:1877361186569600:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1790391767.435591:0:22801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391767.435613:0:22801:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51823a1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790391767.435630:0:24284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186569600 00000100:00100000:1.0:1790391767.435640:0:24284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186569600 00000100:00100000:1.0:1790391767.435677:0:24284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790391767.435683:0:24284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22801:x1877361186569600:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:1.0:1790391767.435847:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790391767.435938:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186569472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790391767.435966:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391767.439414:0:24287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186569472 00000100:00100000:1.0:1790391767.439432:0:24287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186569472 00000100:00100000:1.0:1790391767.439491:0:24287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790391767.439502:0:24287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288345c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1877361186569472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790391767.439533:0:24287:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1790391767.439623:0:24287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288345c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1877361186569472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (3655us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391767.439630:0:24287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790391767.439699:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e51820adf80 x1877361186569472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391783 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391767.439721:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186569472:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1790391767.441556:0:22756:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:1.0:1790391767.449191:0:24284:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1790391767.449209:0:24284:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:1.0:1790391767.449217:0:24284:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00002000:00010000:1.0:1790391767.464108:0:24284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790391767.464131:0:24284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a3f9cf9/0x2b1b7949f13e2bdb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.464156:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=680s v=(0 0) 00010000:00010000:1.0:1790391767.464401:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391767.464410:0:24284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a3f9cf9/0x2b1b7949f13e2bdb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.464464:0:24284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a3f9cf9/0x2b1b7949f13e2bdb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.464479:0:24284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a3f9cf9/0x2b1b7949f13e2bdb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.464488:0:24284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a3f9cf9/0x2b1b7949f13e2bdb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.464594:0:24284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790391767.464640:0:22764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391767.464657:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a3f9cf9/0x2b1b7949f13e2bdb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.464674:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5184054200 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:3.0:1790391767.464680:0:22764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a3f9cf9/0x2b1b7949f13e2bdb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.464692:0:22764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a3f9cf9/0x2b1b7949f13e2bdb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.464726:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a3f9cf9/0x2b1b7949f13e2bdb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.464735:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a3f9cf9/0x2b1b7949f13e2bdb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.464810:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391767.464813:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391767.464815:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790391767.465797:0:24284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790391767.465809:0:24284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005720c40b/0x2b1b7949f13e2be2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.465825:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=680s v=(0 0) 00010000:00010000:1.0:1790391767.465829:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391767.465835:0:24284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005720c40b/0x2b1b7949f13e2be2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.465849:0:24284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005720c40b/0x2b1b7949f13e2be2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.465859:0:24284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005720c40b/0x2b1b7949f13e2be2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.466107:0:24284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005720c40b/0x2b1b7949f13e2be2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.466207:0:24284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790391767.466648:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391767.466659:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005720c40b/0x2b1b7949f13e2be2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391767.466669:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5184054600 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:2.0:1790391767.466674:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005720c40b/0x2b1b7949f13e2be2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391767.466685:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005720c40b/0x2b1b7949f13e2be2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391767.466704:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005720c40b/0x2b1b7949f13e2be2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391767.466712:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005720c40b/0x2b1b7949f13e2be2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391767.466735:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391767.466737:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391767.466739:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790391767.468191:0:24284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391767.468205:0:24284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ef2ca91/0x2b1b7949f13e2be9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.468222:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=680s v=(0 0) 00010000:00010000:0.0:1790391767.468227:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391767.468234:0:24284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ef2ca91/0x2b1b7949f13e2be9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.468250:0:24284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ef2ca91/0x2b1b7949f13e2be9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.468260:0:24284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ef2ca91/0x2b1b7949f13e2be9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.468269:0:24284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ef2ca91/0x2b1b7949f13e2be9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.468566:0:24284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790391767.469179:0:24284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391767.469196:0:24284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085e640e3/0x2b1b7949f13e2bf0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.469210:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=680s v=(0 0) 00010000:00010000:0.0:1790391767.469213:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391767.469219:0:24284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085e640e3/0x2b1b7949f13e2bf0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.469232:0:24284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085e640e3/0x2b1b7949f13e2bf0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.469241:0:24284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085e640e3/0x2b1b7949f13e2bf0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.469249:0:24284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085e640e3/0x2b1b7949f13e2bf0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.473749:0:22764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790391767.473838:0:24284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790391767.474563:0:24284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391767.474573:0:24284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053410c85/0x2b1b7949f13e2bf7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.474591:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=680s v=(0 0) 00010000:00010000:0.0:1790391767.474596:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391767.474603:0:24284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053410c85/0x2b1b7949f13e2bf7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.474617:0:24284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053410c85/0x2b1b7949f13e2bf7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.474635:0:24284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053410c85/0x2b1b7949f13e2bf7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.474644:0:24284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053410c85/0x2b1b7949f13e2bf7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391767.474704:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790391767.474712:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085e640e3/0x2b1b7949f13e2bf0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391767.474727:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295144200 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:2.0:1790391767.474732:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085e640e3/0x2b1b7949f13e2bf0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391767.474741:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085e640e3/0x2b1b7949f13e2bf0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391767.474757:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085e640e3/0x2b1b7949f13e2bf0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391767.474765:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085e640e3/0x2b1b7949f13e2bf0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391767.474796:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391767.474800:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053410c85/0x2b1b7949f13e2bf7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391767.474807:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295145200 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:2.0:1790391767.474810:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053410c85/0x2b1b7949f13e2bf7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391767.474817:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053410c85/0x2b1b7949f13e2bf7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391767.474827:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053410c85/0x2b1b7949f13e2bf7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391767.474841:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391767.474843:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391767.474845:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391767.485999:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ef2ca91/0x2b1b7949f13e2be9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.486037:0:24284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790391767.486051:0:24284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053410c85/0x2b1b7949f13e2bf7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.486070:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295145c00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:3.0:1790391767.486076:0:22764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ef2ca91/0x2b1b7949f13e2be9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.486088:0:22764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ef2ca91/0x2b1b7949f13e2be9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.486109:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ef2ca91/0x2b1b7949f13e2be9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.486116:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ef2ca91/0x2b1b7949f13e2be9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.486135:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391767.486137:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391767.486160:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790391767.487573:0:24284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391767.487586:0:24284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f98c48e/0x2b1b7949f13e2bfe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.487602:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=680s v=(0 0) 00010000:00010000:0.0:1790391767.487607:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391767.487614:0:24284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f98c48e/0x2b1b7949f13e2bfe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.487627:0:24284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f98c48e/0x2b1b7949f13e2bfe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.487638:0:24284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f98c48e/0x2b1b7949f13e2bfe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.487663:0:24284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f98c48e/0x2b1b7949f13e2bfe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.488409:0:24284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790391767.489725:0:24284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391767.489738:0:24284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098169a9f/0x2b1b7949f13e2c05 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.489755:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=680s v=(0 0) 00010000:00010000:0.0:1790391767.489759:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391767.489765:0:24284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098169a9f/0x2b1b7949f13e2c05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.489791:0:24284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098169a9f/0x2b1b7949f13e2c05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.489802:0:24284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098169a9f/0x2b1b7949f13e2c05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.489810:0:24284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098169a9f/0x2b1b7949f13e2c05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.489823:0:24284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790391767.492768:0:22764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790391767.492782:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f98c48e/0x2b1b7949f13e2bfe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.492820:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295145400 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:3.0:1790391767.492826:0:22764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f98c48e/0x2b1b7949f13e2bfe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.492838:0:22764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f98c48e/0x2b1b7949f13e2bfe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.492863:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f98c48e/0x2b1b7949f13e2bfe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.492871:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f98c48e/0x2b1b7949f13e2bfe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.492922:0:22764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391767.492926:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098169a9f/0x2b1b7949f13e2c05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.492932:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295144c00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:3.0:1790391767.492935:0:22764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098169a9f/0x2b1b7949f13e2c05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.492942:0:22764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098169a9f/0x2b1b7949f13e2c05 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.492951:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098169a9f/0x2b1b7949f13e2c05 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.492964:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098169a9f/0x2b1b7949f13e2c05 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.492979:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391767.492981:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391767.492983:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790391767.493024:0:24284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391767.493032:0:24284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d053a9f/0x2b1b7949f13e2c0c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.493055:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=680s v=(0 0) 00010000:00010000:0.0:1790391767.493060:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391767.493067:0:24284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d053a9f/0x2b1b7949f13e2c0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.493079:0:24284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d053a9f/0x2b1b7949f13e2c0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.493089:0:24284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d053a9f/0x2b1b7949f13e2c0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.493097:0:24284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d053a9f/0x2b1b7949f13e2c0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.493125:0:24284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790391767.493356:0:22764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391767.493361:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d053a9f/0x2b1b7949f13e2c0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.493369:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295144000 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:3.0:1790391767.493372:0:22764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d053a9f/0x2b1b7949f13e2c0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.493391:0:22764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d053a9f/0x2b1b7949f13e2c0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.493403:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d053a9f/0x2b1b7949f13e2c0c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.493410:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d053a9f/0x2b1b7949f13e2c0c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.493423:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391767.493424:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391767.493426:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790391767.493808:0:24284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391767.493815:0:24284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6dda782/0x2b1b7949f13e2c13 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.493824:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=680s v=(0 0) 00010000:00010000:0.0:1790391767.493828:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391767.493832:0:24284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6dda782/0x2b1b7949f13e2c13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.493843:0:24284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6dda782/0x2b1b7949f13e2c13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.493864:0:24284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6dda782/0x2b1b7949f13e2c13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.493872:0:24284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6dda782/0x2b1b7949f13e2c13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.493923:0:24284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790391767.494398:0:24284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391767.494404:0:24284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2f5bb09/0x2b1b7949f13e2c1a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.494414:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=680s v=(0 0) 00010000:00010000:0.0:1790391767.494417:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391767.494421:0:24284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2f5bb09/0x2b1b7949f13e2c1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.494431:0:24284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2f5bb09/0x2b1b7949f13e2c1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.494440:0:24284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2f5bb09/0x2b1b7949f13e2c1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.494447:0:24284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2f5bb09/0x2b1b7949f13e2c1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.494466:0:24284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790391767.494635:0:22764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790391767.494642:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6dda782/0x2b1b7949f13e2c13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.494650:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280030000 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:3.0:1790391767.494654:0:22764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6dda782/0x2b1b7949f13e2c13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.494663:0:22764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6dda782/0x2b1b7949f13e2c13 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.494675:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6dda782/0x2b1b7949f13e2c13 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.494684:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6dda782/0x2b1b7949f13e2c13 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.494702:0:22764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391767.494706:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2f5bb09/0x2b1b7949f13e2c1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.494712:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280030400 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:3.0:1790391767.494716:0:22764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2f5bb09/0x2b1b7949f13e2c1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.494724:0:22764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2f5bb09/0x2b1b7949f13e2c1a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.494746:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2f5bb09/0x2b1b7949f13e2c1a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.494753:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2f5bb09/0x2b1b7949f13e2c1a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.494766:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391767.494768:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391767.494770:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790391767.494871:0:24284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391767.494894:0:24284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009550a154/0x2b1b7949f13e2c21 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.494912:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=680s v=(0 0) 00010000:00010000:0.0:1790391767.494916:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391767.494920:0:24284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009550a154/0x2b1b7949f13e2c21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.494930:0:24284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009550a154/0x2b1b7949f13e2c21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.494939:0:24284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009550a154/0x2b1b7949f13e2c21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.494947:0:24284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009550a154/0x2b1b7949f13e2c21 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.494967:0:24284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790391767.495447:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391767.495455:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009550a154/0x2b1b7949f13e2c21 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.495457:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391767.495463:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280031e00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:2.0:1790391767.495467:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009550a154/0x2b1b7949f13e2c21 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391767.495476:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009550a154/0x2b1b7949f13e2c21 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391767.495541:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009550a154/0x2b1b7949f13e2c21 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391767.495551:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009550a154/0x2b1b7949f13e2c21 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391767.495571:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391767.495573:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391767.495574:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790391767.496148:0:24284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391767.496157:0:24284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fa0e299/0x2b1b7949f13e2c28 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.496168:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=680s v=(0 0) 00010000:00010000:0.0:1790391767.496181:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391767.496187:0:24284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fa0e299/0x2b1b7949f13e2c28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.496200:0:24284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fa0e299/0x2b1b7949f13e2c28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.496210:0:24284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fa0e299/0x2b1b7949f13e2c28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.496218:0:24284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fa0e299/0x2b1b7949f13e2c28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.496236:0:24284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790391767.497026:0:22764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391767.497036:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fa0e299/0x2b1b7949f13e2c28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.497046:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280030e00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:3.0:1790391767.497051:0:22764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fa0e299/0x2b1b7949f13e2c28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.497061:0:22764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fa0e299/0x2b1b7949f13e2c28 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.497080:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fa0e299/0x2b1b7949f13e2c28 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.497087:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fa0e299/0x2b1b7949f13e2c28 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.497125:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391767.497127:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391767.497129:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790391767.497698:0:24284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391767.497706:0:24284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009cc1de1d/0x2b1b7949f13e2c2f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.497717:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=680s v=(0 0) 00010000:00010000:0.0:1790391767.497721:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391767.497726:0:24284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009cc1de1d/0x2b1b7949f13e2c2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.497738:0:24284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009cc1de1d/0x2b1b7949f13e2c2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.497746:0:24284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009cc1de1d/0x2b1b7949f13e2c2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.497760:0:24284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009cc1de1d/0x2b1b7949f13e2c2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.497793:0:24284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790391767.498011:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391767.498017:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009cc1de1d/0x2b1b7949f13e2c2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.498025:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280031600 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:1.0:1790391767.498029:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009cc1de1d/0x2b1b7949f13e2c2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.498039:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009cc1de1d/0x2b1b7949f13e2c2f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.498053:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009cc1de1d/0x2b1b7949f13e2c2f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.498060:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009cc1de1d/0x2b1b7949f13e2c2f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.498079:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391767.498081:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391767.498083:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790391767.498421:0:24284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391767.498428:0:24284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000482d6837/0x2b1b7949f13e2c36 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.498438:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=680s v=(0 0) 00010000:00010000:0.0:1790391767.498441:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391767.498445:0:24284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000482d6837/0x2b1b7949f13e2c36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.498455:0:24284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000482d6837/0x2b1b7949f13e2c36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.498462:0:24284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000482d6837/0x2b1b7949f13e2c36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.498468:0:24284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000482d6837/0x2b1b7949f13e2c36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.498629:0:24284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790391767.498949:0:22764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391767.498957:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000482d6837/0x2b1b7949f13e2c36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.498965:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280030600 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:3.0:1790391767.498969:0:22764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000482d6837/0x2b1b7949f13e2c36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.498979:0:22764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000482d6837/0x2b1b7949f13e2c36 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.498992:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000482d6837/0x2b1b7949f13e2c36 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.499001:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000482d6837/0x2b1b7949f13e2c36 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.499015:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391767.499017:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391767.499019:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790391767.500677:0:24284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391767.500690:0:24284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f56e3edc/0x2b1b7949f13e2c3d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.500715:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=680s v=(0 0) 00010000:00010000:0.0:1790391767.500720:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391767.500727:0:24284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f56e3edc/0x2b1b7949f13e2c3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.500742:0:24284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f56e3edc/0x2b1b7949f13e2c3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.500752:0:24284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f56e3edc/0x2b1b7949f13e2c3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.500761:0:24284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f56e3edc/0x2b1b7949f13e2c3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.500831:0:24284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790391767.501360:0:24284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391767.501366:0:24284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b769297/0x2b1b7949f13e2c44 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.501376:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=680s v=(0 0) 00010000:00010000:0.0:1790391767.501379:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391767.501383:0:24284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b769297/0x2b1b7949f13e2c44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.501393:0:24284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b769297/0x2b1b7949f13e2c44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.501413:0:24284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b769297/0x2b1b7949f13e2c44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.501420:0:24284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b769297/0x2b1b7949f13e2c44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.501637:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790391767.501644:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f56e3edc/0x2b1b7949f13e2c3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.501659:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280031800 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:1.0:1790391767.501663:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f56e3edc/0x2b1b7949f13e2c3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.501674:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f56e3edc/0x2b1b7949f13e2c3d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.501690:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f56e3edc/0x2b1b7949f13e2c3d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.501698:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f56e3edc/0x2b1b7949f13e2c3d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.501717:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391767.501721:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b769297/0x2b1b7949f13e2c44 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.501727:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280031a00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:1.0:1790391767.501729:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b769297/0x2b1b7949f13e2c44 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.501737:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b769297/0x2b1b7949f13e2c44 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.501746:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b769297/0x2b1b7949f13e2c44 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.501759:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391767.501761:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391767.501763:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391767.501839:0:24284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790391767.501845:0:24284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b769297/0x2b1b7949f13e2c44 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790391767.502574:0:24284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391767.502582:0:24284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002536b386/0x2b1b7949f13e2c4b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.502593:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=680s v=(0 0) 00010000:00010000:0.0:1790391767.502597:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391767.502602:0:24284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002536b386/0x2b1b7949f13e2c4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.502613:0:24284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002536b386/0x2b1b7949f13e2c4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.502622:0:24284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002536b386/0x2b1b7949f13e2c4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.502641:0:24284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002536b386/0x2b1b7949f13e2c4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.502700:0:24284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790391767.503142:0:24284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391767.503149:0:24284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b83df72c/0x2b1b7949f13e2c52 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.503159:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=680s v=(0 0) 00010000:00010000:0.0:1790391767.503162:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391767.503167:0:24284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b83df72c/0x2b1b7949f13e2c52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.503177:0:24284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b83df72c/0x2b1b7949f13e2c52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.503186:0:24284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b83df72c/0x2b1b7949f13e2c52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.503194:0:24284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b83df72c/0x2b1b7949f13e2c52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.503468:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790391767.503476:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002536b386/0x2b1b7949f13e2c4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.505520:0:22764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391767.505702:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391767.505710:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b83df72c/0x2b1b7949f13e2c52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.505735:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280031400 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:3.0:1790391767.505740:0:22764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b83df72c/0x2b1b7949f13e2c52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.505752:0:22764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b83df72c/0x2b1b7949f13e2c52 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.505775:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b83df72c/0x2b1b7949f13e2c52 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.505785:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391767.505787:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391767.505789:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391767.505794:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391767.505796:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391767.506477:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280030200 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:1.0:1790391767.506494:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002536b386/0x2b1b7949f13e2c4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.506506:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002536b386/0x2b1b7949f13e2c4b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.506520:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002536b386/0x2b1b7949f13e2c4b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.506527:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002536b386/0x2b1b7949f13e2c4b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.506553:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391767.506555:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391767.506557:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391767.506767:0:24284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790391767.506775:0:24284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b83df72c/0x2b1b7949f13e2c52 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790391767.507516:0:24284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391767.507525:0:24284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009550a154/0x2b1b7949f13e2c59 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.507536:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=680s v=(0 0) 00010000:00010000:0.0:1790391767.507541:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391767.507548:0:24284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009550a154/0x2b1b7949f13e2c59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.507561:0:24284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009550a154/0x2b1b7949f13e2c59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.507570:0:24284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009550a154/0x2b1b7949f13e2c59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.507577:0:24284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009550a154/0x2b1b7949f13e2c59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.507597:0:24284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790391767.507612:0:22764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391767.507618:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009550a154/0x2b1b7949f13e2c59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.507626:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280031e00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:3.0:1790391767.507630:0:22764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009550a154/0x2b1b7949f13e2c59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.507639:0:22764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009550a154/0x2b1b7949f13e2c59 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.507665:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009550a154/0x2b1b7949f13e2c59 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.507673:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009550a154/0x2b1b7949f13e2c59 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.507688:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391767.507690:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391767.507692:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790391767.507997:0:24284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391767.508004:0:24284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000482d6837/0x2b1b7949f13e2c60 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.508012:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=680s v=(0 0) 00010000:00010000:0.0:1790391767.508015:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391767.508026:0:24284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000482d6837/0x2b1b7949f13e2c60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.508036:0:24284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000482d6837/0x2b1b7949f13e2c60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.508044:0:24284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000482d6837/0x2b1b7949f13e2c60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.508051:0:24284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000482d6837/0x2b1b7949f13e2c60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.508208:0:24284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790391767.508615:0:24284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391767.508621:0:24284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fa0e299/0x2b1b7949f13e2c67 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.508631:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=680s v=(0 0) 00010000:00010000:0.0:1790391767.508634:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391767.508638:0:24284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fa0e299/0x2b1b7949f13e2c67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.508648:0:24284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fa0e299/0x2b1b7949f13e2c67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.508656:0:24284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fa0e299/0x2b1b7949f13e2c67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.508675:0:24284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fa0e299/0x2b1b7949f13e2c67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391767.508707:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790391767.508714:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000482d6837/0x2b1b7949f13e2c60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391767.508727:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280030600 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:2.0:1790391767.508731:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000482d6837/0x2b1b7949f13e2c60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391767.508739:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000482d6837/0x2b1b7949f13e2c60 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391767.508752:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000482d6837/0x2b1b7949f13e2c60 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391767.508758:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000482d6837/0x2b1b7949f13e2c60 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391767.508773:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391767.508776:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fa0e299/0x2b1b7949f13e2c67 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391767.508793:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280030e00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:2.0:1790391767.508796:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fa0e299/0x2b1b7949f13e2c67 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391767.508802:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fa0e299/0x2b1b7949f13e2c67 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391767.508812:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fa0e299/0x2b1b7949f13e2c67 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391767.508825:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391767.508826:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391767.508828:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391767.513829:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391767.516617:0:24284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790391767.516634:0:24284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fa0e299/0x2b1b7949f13e2c67 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.516938:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790391767.518338:0:24284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391767.518348:0:24284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b769297/0x2b1b7949f13e2c6e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.518365:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=680s v=(0 0) 00010000:00010000:0.0:1790391767.518369:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391767.518376:0:24284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b769297/0x2b1b7949f13e2c6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.518391:0:24284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b769297/0x2b1b7949f13e2c6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.518401:0:24284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b769297/0x2b1b7949f13e2c6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.518409:0:24284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b769297/0x2b1b7949f13e2c6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.518448:0:24284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790391767.518575:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391767.518582:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b769297/0x2b1b7949f13e2c6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391767.518590:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280031a00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:2.0:1790391767.518594:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b769297/0x2b1b7949f13e2c6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391767.518604:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b769297/0x2b1b7949f13e2c6e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391767.518620:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b769297/0x2b1b7949f13e2c6e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391767.518627:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b769297/0x2b1b7949f13e2c6e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391767.518646:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391767.518648:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391767.518650:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790391767.519454:0:24284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391767.519665:0:24284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2f5bb09/0x2b1b7949f13e2c75 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.519679:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=680s v=(0 0) 00010000:00010000:0.0:1790391767.519683:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391767.519687:0:24284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2f5bb09/0x2b1b7949f13e2c75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.519700:0:24284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2f5bb09/0x2b1b7949f13e2c75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.519709:0:24284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2f5bb09/0x2b1b7949f13e2c75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.519716:0:24284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2f5bb09/0x2b1b7949f13e2c75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.519792:0:24284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790391767.520295:0:24284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391767.520301:0:24284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6dda782/0x2b1b7949f13e2c7c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.520310:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=680s v=(0 0) 00010000:00010000:0.0:1790391767.520321:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391767.520326:0:24284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6dda782/0x2b1b7949f13e2c7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.520337:0:24284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6dda782/0x2b1b7949f13e2c7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.520346:0:24284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6dda782/0x2b1b7949f13e2c7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.520353:0:24284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6dda782/0x2b1b7949f13e2c7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.523632:0:24815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790391767.523650:0:24815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2f5bb09/0x2b1b7949f13e2c75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.523680:0:24815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280030400 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:1.0:1790391767.523683:0:24815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2f5bb09/0x2b1b7949f13e2c75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.523693:0:24815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2f5bb09/0x2b1b7949f13e2c75 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.523711:0:24815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2f5bb09/0x2b1b7949f13e2c75 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.523716:0:24815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2f5bb09/0x2b1b7949f13e2c75 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.523740:0:24815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391767.523742:0:24815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6dda782/0x2b1b7949f13e2c7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.523746:0:24815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280030000 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:1.0:1790391767.523747:0:24815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6dda782/0x2b1b7949f13e2c7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.523752:0:24815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6dda782/0x2b1b7949f13e2c7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.523756:0:24815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6dda782/0x2b1b7949f13e2c7c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.523764:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391767.523765:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391767.523767:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391767.534686:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391767.534723:0:24284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790391767.534734:0:24284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6dda782/0x2b1b7949f13e2c7c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790391767.542511:0:24284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391767.542529:0:24284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f56e3edc/0x2b1b7949f13e2c83 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.542547:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=680s v=(0 0) 00010000:00010000:0.0:1790391767.542552:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391767.542559:0:24284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f56e3edc/0x2b1b7949f13e2c83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.542574:0:24284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f56e3edc/0x2b1b7949f13e2c83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.542594:0:24284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f56e3edc/0x2b1b7949f13e2c83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.542602:0:24284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f56e3edc/0x2b1b7949f13e2c83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.542631:0:24284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790391767.542654:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391767.542661:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f56e3edc/0x2b1b7949f13e2c83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.542668:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280031800 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:3.0:1790391767.542673:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f56e3edc/0x2b1b7949f13e2c83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.542682:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f56e3edc/0x2b1b7949f13e2c83 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.542698:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f56e3edc/0x2b1b7949f13e2c83 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.542705:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f56e3edc/0x2b1b7949f13e2c83 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.542733:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391767.542734:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391767.542736:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790391767.545685:0:24284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790391767.545702:0:24284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002ac3bc1/0x2b1b7949f13e2c8a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.545719:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=680s v=(0 0) 00010000:00010000:3.0:1790391767.545723:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391767.545730:0:24284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002ac3bc1/0x2b1b7949f13e2c8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.545745:0:24284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002ac3bc1/0x2b1b7949f13e2c8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.545756:0:24284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002ac3bc1/0x2b1b7949f13e2c8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.545763:0:24284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002ac3bc1/0x2b1b7949f13e2c8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.545795:0:24284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790391767.547131:0:24284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790391767.547153:0:24284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053df5711/0x2b1b7949f13e2c91 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.547183:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=680s v=(0 0) 00010000:00010000:3.0:1790391767.547187:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391767.547187:0:24815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391767.547192:0:24284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053df5711/0x2b1b7949f13e2c91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.547195:0:24815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002ac3bc1/0x2b1b7949f13e2c8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.547203:0:24815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52bab9c600 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:3.0:1790391767.547205:0:24284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053df5711/0x2b1b7949f13e2c91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.547208:0:24815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002ac3bc1/0x2b1b7949f13e2c8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.547215:0:24284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053df5711/0x2b1b7949f13e2c91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.547217:0:24815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002ac3bc1/0x2b1b7949f13e2c8a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.547224:0:24284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053df5711/0x2b1b7949f13e2c91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.547234:0:24815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002ac3bc1/0x2b1b7949f13e2c8a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.547241:0:24815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002ac3bc1/0x2b1b7949f13e2c8a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.547248:0:24284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790391767.547260:0:24815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391767.547262:0:24815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053df5711/0x2b1b7949f13e2c91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.547268:0:24815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52bab9d800 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:1.0:1790391767.547277:0:24815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053df5711/0x2b1b7949f13e2c91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.547285:0:24815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053df5711/0x2b1b7949f13e2c91 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.547295:0:24815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053df5711/0x2b1b7949f13e2c91 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.547301:0:24815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053df5711/0x2b1b7949f13e2c91 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.547312:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391767.547313:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391767.547315:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391767.547352:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790391767.547859:0:24284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790391767.547867:0:24284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009a6a2c5/0x2b1b7949f13e2c98 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.547896:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=680s v=(0 0) 00010000:00010000:3.0:1790391767.547900:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391767.547916:0:24284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009a6a2c5/0x2b1b7949f13e2c98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.547927:0:24284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009a6a2c5/0x2b1b7949f13e2c98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.547950:0:24284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009a6a2c5/0x2b1b7949f13e2c98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.547958:0:24284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009a6a2c5/0x2b1b7949f13e2c98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391767.547982:0:24284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790391767.548028:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391767.548035:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009a6a2c5/0x2b1b7949f13e2c98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.548043:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52bab9ca00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:0.0:1790391767.548046:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009a6a2c5/0x2b1b7949f13e2c98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.548055:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009a6a2c5/0x2b1b7949f13e2c98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.548068:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009a6a2c5/0x2b1b7949f13e2c98 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.548075:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009a6a2c5/0x2b1b7949f13e2c98 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.548103:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391767.548104:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391767.548106:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790391767.548446:0:24284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391767.548452:0:24284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b83df72c/0x2b1b7949f13e2c9f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.548461:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=680s v=(0 0) 00010000:00010000:0.0:1790391767.548464:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391767.548468:0:24284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b83df72c/0x2b1b7949f13e2c9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.548477:0:24284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b83df72c/0x2b1b7949f13e2c9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.548484:0:24284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b83df72c/0x2b1b7949f13e2c9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.548492:0:24284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b83df72c/0x2b1b7949f13e2c9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.548514:0:24284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790391767.548644:0:24815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391767.548650:0:24815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b83df72c/0x2b1b7949f13e2c9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.548658:0:24815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280031400 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:1.0:1790391767.548661:0:24815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b83df72c/0x2b1b7949f13e2c9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.548671:0:24815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b83df72c/0x2b1b7949f13e2c9f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.548682:0:24815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b83df72c/0x2b1b7949f13e2c9f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.548697:0:24815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b83df72c/0x2b1b7949f13e2c9f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.548718:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391767.548721:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391767.548723:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790391767.548791:0:24284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391767.548796:0:24284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009cc1de1d/0x2b1b7949f13e2ca6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.548816:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=680s v=(0 0) 00010000:00010000:0.0:1790391767.548819:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391767.548823:0:24284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009cc1de1d/0x2b1b7949f13e2ca6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.548833:0:24284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009cc1de1d/0x2b1b7949f13e2ca6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.548841:0:24284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009cc1de1d/0x2b1b7949f13e2ca6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.548849:0:24284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009cc1de1d/0x2b1b7949f13e2ca6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.548872:0:24284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790391767.548933:0:22764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391767.548938:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009cc1de1d/0x2b1b7949f13e2ca6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.548946:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280031600 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:1.0:1790391767.548950:0:22764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009cc1de1d/0x2b1b7949f13e2ca6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.548958:0:22764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009cc1de1d/0x2b1b7949f13e2ca6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.548969:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009cc1de1d/0x2b1b7949f13e2ca6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.548977:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009cc1de1d/0x2b1b7949f13e2ca6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.548990:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391767.548991:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391767.548993:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790391767.553259:0:24284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391767.553272:0:24284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6dda782/0x2b1b7949f13e2cad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.553290:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=680s v=(0 0) 00010000:00010000:0.0:1790391767.553295:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391767.553302:0:24284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6dda782/0x2b1b7949f13e2cad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.553318:0:24284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6dda782/0x2b1b7949f13e2cad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.553341:0:24284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6dda782/0x2b1b7949f13e2cad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.553349:0:24284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6dda782/0x2b1b7949f13e2cad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391767.553371:0:24284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790391767.553398:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391767.553405:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6dda782/0x2b1b7949f13e2cad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.553413:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280030000 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:1.0:1790391767.553417:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6dda782/0x2b1b7949f13e2cad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.553426:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6dda782/0x2b1b7949f13e2cad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.553441:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6dda782/0x2b1b7949f13e2cad lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391767.553448:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6dda782/0x2b1b7949f13e2cad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1790391767.553459:0:24284:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00010000:00010000:1.0:1790391767.553463:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391767.553465:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391767.553466:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391767.553557:0:24284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22801:x1877361186569600:12345-0@lo:5:osp-pre-0-0.0 Request processed in 117870us (117961us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391767.553567:0:24284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790391767.553589:0:22801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820af800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22801:1877361186569600:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1790391767.553604:0:22801:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00000100:00100000:1.0:1790391767.553648:0:22801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820af800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22801:1877361186569728:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1790391767.553682:0:22801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391767.558016:0:22801:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51823a1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790391767.561523:0:24285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186569728 00000100:00100000:0.0:1790391767.561541:0:24285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186569728 00000100:00100000:1.0:1790391767.561860:0:24285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790391767.561901:0:24285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22801:x1877361186569728:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1790391767.561961:0:24285:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000001:00080000:0.0:1790391767.567409:0:24280:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:0.0:1790391767.567461:0:24280:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1790391767.567747:0:24285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22801:x1877361186569728:12345-0@lo:5:osp-pre-0-0.0 Request processed in 5865us (14058us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1790391767.567758:0:24285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790391767.567840:0:22801:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1790391767.567849:0:22801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820af800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22801:1877361186569728:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1790391767.567977:0:22801:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:3.0:1790391767.888155:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391768.904137:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391769.929804:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391770.954553:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391771.656665:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186569856:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790391771.656742:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391771.656800:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186569856 00000100:00100000:1.0:1790391771.656808:0:22781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186569856 00000100:00100000:1.0:1790391771.656859:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790391771.656897:0:22781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186569856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790391771.656933:0:22781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1790391771.656980:0:22781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186569856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391771.656987:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790391771.657033:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186569856:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790391771.657299:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790391771.657309:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186569984:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790391771.657340:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391771.657403:0:24287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186569984 00000100:00100000:2.0:1790391771.657409:0:24287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186569984 00000100:00100000:2.0:1790391771.657464:0:24287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790391771.657472:0:24287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bb399880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186569984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790391771.657490:0:24287:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1790391771.657525:0:24287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bb399880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186569984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391771.657531:0:24287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1790391771.657626:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790391771.657652:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186569984:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1790391771.976256:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391772.172725:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288346680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186570112:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790391772.172798:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391772.173567:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186570112 00000100:00100000:1.0:1790391772.173579:0:22781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186570112 00000100:00100000:1.0:1790391772.173637:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790391772.173647:0:22781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183baaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186570112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790391772.173683:0:22781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790391772.180227:0:22781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183baaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186570112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6571us (7419us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391772.180253:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790391772.180510:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288346680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186570112:0@lo:41:osp-pre-1-0.0 00000020:01000004:3.0:1790391772.588674:0:25100:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790391772.588678:0:25100:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1790391772.588680:0:25100:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1790391772.588818:0:25100:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e5284edc000 00000020:01000004:3.0:1790391772.588834:0:25100:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1790391772.588852:0:25100:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1790391772.588908:0:25100:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9e52b9d73380) 00000020:00000080:3.0:1790391772.588929:0:25100:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1790391772.659808:0:25100:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1790391772.662287:0:25100:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1790391772.662978:0:25100:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1790391772.663237:0:25100:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1790391772.663486:0:25100:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1790391772.663783:0:25100:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1790391772.664113:0:25100:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:2.0:1790391772.667347:0:25100:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1790391772.667726:0:25100:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1790391772.667741:0:25100:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790391772.667753:0:25100:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2b1b7949f13e2cbb 00000020:01000004:2.0:1790391772.667760:0:25100:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1790391772.667782:0:25100:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.128@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790391772.667795:0:25100:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.128@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790391772.667802:0:25100:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1790391772.667832:0:25100:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1790391772.667837:0:25100:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.128@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1790391772.677533:0:25100:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.128@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790391772.677647:0:25100:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.128@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1790391772.677653:0:25100:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790391772.677659:0:25100:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790391772.677660:0:25100:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790391772.677661:0:25100:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790391772.677662:0:25100:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790391772.677664:0:25100:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790391772.677665:0:25100:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790391772.677666:0:25100:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790391772.677667:0:25100:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790391772.677671:0:25100:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1790391772.677672:0:25100:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790391772.677673:0:25100:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790391772.677674:0:25100:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790391772.677675:0:25100:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790391772.677676:0:25100:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790391772.677677:0:25100:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790391772.677678:0:25100:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790391772.677679:0:25100:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790391772.677680:0:25100:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790391772.677708:0:25100:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1790391772.677729:0:25100:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288344000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:25100:1877361186570240:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790391772.677813:0:25100:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391772.677873:0:25100:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290b46840 going to sleep for 11 seconds 00000100:00100000:1.0:1790391772.683173:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186570240 00000100:00100000:1.0:1790391772.683186:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186570240 00000100:00100000:1.0:1790391772.683244:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1790391772.683253:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+21:25100:x1877361186570240:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790391772.683311:0:22771:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1790391772.683314:0:22771:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1790391772.683318:0:22771:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00080000:2.0:1790391772.684243:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790391772.684247:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790391772.684250:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e528493c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790391772.684257:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 680 00000100:00080000:2.0:1790391772.684262:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1790391772.684268:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e528493c000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:2.0:1790391772.684288:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5288344700 x1877361186570624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790391772.684337:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790391772.684341:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790391772.684343:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e52b5cbb800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790391772.684355:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 680 00000100:00080000:2.0:1790391772.684358:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1790391772.684361:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e52b5cbb800 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:2.0:1790391772.684374:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e51831ddc00 x1877361186571136/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790391772.684489:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877361186570752:0@lo:400:kworker.0 00000100:00100000:2.0:1790391772.684560:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391772.685058:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288346680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186570368:0@lo:400:kworker.0 00000100:00100000:1.0:1790391772.685096:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391772.685130:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186571008:0@lo:400:kworker.0 00000100:00100000:1.0:1790391772.685151:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391772.685169:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186571648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790391772.685188:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391772.685212:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790391772.685217:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186570496:0@lo:400:kworker.0 00000100:00100000:1.0:1790391772.685235:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391772.685246:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186571264:0@lo:400:kworker.0 00000100:00100000:1.0:1790391772.685316:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+21:25100:x1877361186570240:12345-0@lo:253:mount.lustre.0 Request processed in 2063us (7501us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391772.685325:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1790391772.685366:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186570368 00000100:00100000:1.0:1790391772.685374:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186570368 00000100:00100000:1.0:1790391772.685406:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790391772.685414:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186570368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391772.685474:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186570368:12345-0@lo:400:kworker.0 Request processed in 61us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391772.685481:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790391772.685499:0:24766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186571008 00000100:00100000:1.0:1790391772.685502:0:24766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186571008 00000100:00100000:1.0:1790391772.685522:0:24766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186570496 00000100:00100000:1.0:1790391772.685524:0:24766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186570496 00000100:00100000:1.0:1790391772.685549:0:24766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790391772.685555:0:24766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186571008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391772.685653:0:24766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186571008:12345-0@lo:400:kworker.0 Request processed in 97us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391772.685659:0:24766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790391772.685671:0:24766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790391772.685676:0:24766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518331dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186570496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391772.685698:0:24766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518331dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186570496:12345-0@lo:400:kworker.0 Request processed in 22us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391772.685703:0:24766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790391772.685717:0:24287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186571648 00000100:00100000:1.0:1790391772.685720:0:24287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186571648 00000100:00100000:1.0:1790391772.685739:0:24287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790391772.685744:0:24287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518331e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186571648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790391772.685756:0:24287:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1790391772.685938:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186570880:0@lo:400:kworker.0 00000100:00100000:0.0:1790391772.685967:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391772.685986:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1877361186571520:0@lo:400:kworker.0 00000100:00100000:2.0:1790391772.686091:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1877361186571392:0@lo:400:kworker.0 00000100:00100000:2.0:1790391772.686115:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391772.686164:0:25100:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288344000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:25100:1877361186570240:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790391772.686176:0:25100:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1790391772.686179:0:25100:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790391772.686181:0:25100:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790391772.686182:0:25100:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790391772.686184:0:25100:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790391772.686185:0:25100:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790391772.686187:0:25100:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790391772.686188:0:25100:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790391772.686190:0:25100:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790391772.686191:0:25100:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790391772.686207:0:25100:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e5284edc000 from lustre-OST0001 10000000:01000000:2.0:1790391772.686235:0:25100:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1790391772.686237:0:25100:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1790391772.686245:0:25100:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e52b9d719c0 local copy 00010000:00010000:2.0:1790391772.686254:0:25100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e518309d400/0x2b1b7949f13e28f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e28fc expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391772.686545:0:24287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518331e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186571648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391772.686553:0:24287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790391772.687041:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186570880 00000100:00100000:1.0:1790391772.687048:0:22781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186570880 00000100:00100000:1.0:1790391772.687084:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790391772.687092:0:22781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183ba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186570880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391772.687138:0:22781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183ba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186570880:12345-0@lo:400:kworker.0 Request processed in 47us (1169us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391772.687144:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790391772.687162:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391772.687199:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288346680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186570368:0@lo:400:kworker.0 00000100:00100000:1.0:1790391772.687212:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186571008:0@lo:400:kworker.0 00000100:00100000:1.0:1790391772.687227:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186571648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790391772.687250:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186570496:0@lo:400:kworker.0 00000100:00080000:1.0:1790391772.687270:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790391772.687290:0:23840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186570752 00000100:00100000:1.0:1790391772.687294:0:23840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186570752 00000100:00100000:1.0:1790391772.687318:0:23840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186571392 00000100:00100000:1.0:1790391772.687321:0:23840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186571392 00000100:00100000:1.0:1790391772.687339:0:23840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186571264 00000100:00100000:1.0:1790391772.687342:0:23840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186571264 00000100:00100000:1.0:1790391772.687354:0:23840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790391772.687359:0:23840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf94bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877361186570752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391772.687395:0:23840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf94bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877361186570752:12345-0@lo:400:kworker.0 Request processed in 35us (2835us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391772.687402:0:23840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790391772.687413:0:23840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790391772.687419:0:23840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877361186571392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391772.687458:0:23840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877361186571392:12345-0@lo:400:kworker.0 Request processed in 39us (1342us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391772.687473:0:23840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790391772.687485:0:23840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790391772.687491:0:23840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518331e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186571264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391772.687526:0:23840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518331e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186571264:12345-0@lo:400:kworker.0 Request processed in 35us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391772.687532:0:23840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1790391772.687549:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790391772.687682:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391772.687717:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186570880:0@lo:400:kworker.0 00000100:00100000:2.0:1790391772.688239:0:25100:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf949f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:25100:1877361186571776:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790391772.688280:0:25100:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391772.688318:0:25100:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290b46840 going to sleep for 11 seconds 00010000:00080000:1.0:1790391772.688429:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e51831dd500 x1877361186570752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391772.688525:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186571776 00000100:00100000:0.0:1790391772.688531:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186571776 00000100:00100000:0.0:1790391772.688565:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790391772.688583:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+21:25100:x1877361186571776:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790391772.688650:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+21:25100:x1877361186571776:12345-0@lo:501:mount.lustre.0 Request processed in 68us (369us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790391772.688657:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1790391772.688811:0:25100:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf949f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:25100:1877361186571776:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1790391772.688825:0:25100:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.128@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1790391772.688844:0:25100:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.128@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1790391772.688853:0:25100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e518309d400/0x2b1b7949f13e28f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e28fc expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391772.688900:0:25100:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e518309d400/0x2b1b7949f13e28f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e28fc expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391772.688935:0:25100:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e5284edc000 10000000:01000000:2.0:1790391772.688941:0:25100:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790391772.688947:0:25100:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1790391772.688950:0:25100:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790391772.688955:0:25100:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1790391772.688959:0:25100:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1790391772.688982:0:25100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e518309c800/0x2b1b7949f13e2cc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391772.688991:0:25100:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e518309c800/0x2b1b7949f13e2cc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391772.689001:0:25100:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e518309c800/0x2b1b7949f13e2cc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391772.689015:0:25100:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf949f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:25100:1877361186571904:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790391772.689045:0:25100:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391772.689064:0:25100:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290b46840 going to sleep for 11 seconds 00000100:00100000:1.0:1790391772.689189:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877361186570752:0@lo:400:kworker.0 00010000:00080000:1.0:1790391772.689215:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e51831dce00 x1877361186571392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391772.689225:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1877361186571392:0@lo:400:kworker.0 00010000:00080000:1.0:1790391772.689261:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e51831dd180 x1877361186571264/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391772.689270:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186571264:0@lo:400:kworker.0 00000100:00100000:1.0:1790391772.689293:0:23840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186571520 00000100:00100000:1.0:1790391772.689297:0:23840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186571520 00000100:00100000:1.0:1790391772.689344:0:23840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790391772.689352:0:23840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183baa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877361186571520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391772.689394:0:23840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183baa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877361186571520:12345-0@lo:400:kworker.0 Request processed in 43us (1712us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391772.689401:0:23840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790391772.689430:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186571904 00000100:00100000:1.0:1790391772.689433:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186571904 00000100:00080000:2.0:1790391772.689641:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790391772.689745:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790391772.689752:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+21:25100:x1877361186571904:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790391772.689761:0:22769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391772.689773:0:22769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5184054a00/0x2b1b7949f13e2cc9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e2cc2 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391772.689804:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5184054a00/0x2b1b7949f13e2cc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e2cc2 expref: 22 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391772.689815:0:22769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5184054a00/0x2b1b7949f13e2cc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2cc2 expref: 22 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391772.689824:0:22769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5184054a00, rc 0) 00000100:00100000:1.0:1790391772.689871:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+22:25100:x1877361186571904:12345-0@lo:101:mount.lustre.0 Request processed in 119us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391772.689897:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1790391772.689968:0:25100:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf949f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:25100:1877361186571904:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790391772.689982:0:25100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e518309c800/0x2b1b7949f13e2cc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2cc9 expref: -99 pid: 25100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391772.689991:0:25100:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e518309c800/0x2b1b7949f13e2cc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e2cc9 expref: -99 pid: 25100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391772.690490:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186570624:0@lo:8:kworker.0 00000100:00100000:3.0:1790391772.690534:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391772.690558:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186571136:0@lo:8:kworker.0 00000100:00100000:3.0:1790391772.690591:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1790391772.691806:0:25100:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000100:00100000:0.0:1790391772.692460:0:24284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186570624 00000100:00100000:0.0:1790391772.692470:0:24284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186570624 00000100:00100000:0.0:1790391772.692510:0:24284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186571136 00000100:00100000:0.0:1790391772.692513:0:24284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186571136 00000100:00100000:0.0:1790391772.692535:0:24284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790391772.692543:0:24284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bb39b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1877361186570624:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1790391772.692578:0:24284:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1790391772.692652:0:24284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bb39b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1877361186570624:12345-0@lo:8:kworker.0 Request processed in 108us (2117us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790391772.692660:0:24284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790391772.692676:0:24284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790391772.692680:0:24284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bb399500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1877361186571136:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1790391772.692691:0:24284:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1790391772.692716:0:24284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bb399500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1877361186571136:12345-0@lo:8:kworker.0 Request processed in 35us (2124us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790391772.692721:0:24284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1790391772.692753:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e528493c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790391772.692758:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790391772.692762:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186570624:0@lo:8:kworker.0 00000100:00080000:0.0:1790391772.693062:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e52b5cbb800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790391772.693068:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790391772.693070:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186571136:0@lo:8:kworker.0 00000040:00080000:2.0:1790391772.693401:0:25100:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00080000:0.0:1790391772.695400:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e51831ddf80 x1877361186571520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391772.695418:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1877361186571520:0@lo:400:kworker.0 00000040:00080000:2.0:1790391772.699536:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1790391772.699757:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1790391772.699777:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1790391772.700400:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1790391772.700421:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1790391772.700436:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1790391772.700449:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1790391772.700463:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1790391772.700496:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:2.0:1790391772.700524:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:2.0:1790391772.700530:0:25100:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:2.0:1790391772.700728:0:25100:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf949f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:25100:1877361186572032:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790391772.701054:0:25100:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391772.701131:0:25100:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290b46780 going to sleep for 11 seconds 00000100:00100000:0.0:1790391772.704471:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186572032 00000100:00100000:0.0:1790391772.704487:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186572032 00000100:00100000:0.0:1790391772.704669:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1790391772.704681:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+22:25100:x1877361186572032:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790391772.704941:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+22:25100:x1877361186572032:12345-0@lo:501:mount.lustre.0 Request processed in 262us (3887us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391772.704949:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790391772.705048:0:25100:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf949f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:25100:1877361186572032:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790391772.705100:0:25100:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf949f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:25100:1877361186572160:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790391772.705158:0:25100:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391772.707728:0:25100:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290b46780 going to sleep for 11 seconds 00000100:00100000:1.0:1790391772.708016:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186572160 00000100:00100000:1.0:1790391772.708027:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186572160 00000100:00100000:1.0:1790391772.708075:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1790391772.708086:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+22:25100:x1877361186572160:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790391772.710735:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+22:25100:x1877361186572160:12345-0@lo:503:mount.lustre.0 Request processed in 2636us (5561us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391772.710757:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790391772.710820:0:25100:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf949f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:25100:1877361186572160:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790391772.711388:0:25100:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790391772.711489:0:25100:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf949f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:25100:1877361186572288:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790391772.711580:0:25100:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391772.711627:0:25100:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52ae87d900 going to sleep for 11 seconds 00000100:00100000:1.0:1790391772.712297:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186572288 00000100:00100000:1.0:1790391772.712312:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186572288 00000100:00100000:1.0:1790391772.716630:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790391772.716665:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+22:25100:x1877361186572288:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790391772.717673:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+22:25100:x1877361186572288:12345-0@lo:502:mount.lustre.0 Request processed in 1019us (6098us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391772.717690:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1790391772.717733:0:25100:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf949f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:25100:1877361186572288:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790391772.718137:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1790391772.718170:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1790391772.718186:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1790391772.718202:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1790391772.718216:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1790391772.718229:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1790391772.718244:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1790391772.718276:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1790391772.718294:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:3.0:1790391772.718356:0:25100:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb398a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:25100:1877361186572416:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790391772.718435:0:25100:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391772.718483:0:25100:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52ae87d900 going to sleep for 11 seconds 00000100:00100000:1.0:1790391772.718601:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186572416 00000100:00100000:1.0:1790391772.718613:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186572416 00000100:00100000:1.0:1790391772.718678:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1790391772.718688:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+22:25100:x1877361186572416:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790391772.718831:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+22:25100:x1877361186572416:12345-0@lo:502:mount.lustre.0 Request processed in 144us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391772.718838:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1790391772.718947:0:25100:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb398a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:25100:1877361186572416:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790391772.719003:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:3.0:1790391772.719012:0:25100:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1790391772.720208:0:25104:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790391772.720219:0:25104:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1790391772.720225:0:25104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391772.720227:0:25104:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1790391772.720233:0:25104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790391772.720248:0:25104:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9e529e97cd40) 00000020:00000080:0.0:1790391772.720273:0:25104:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1790391772.720278:0:25104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790391772.720468:0:25104:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e5284edc000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1790391772.720478:0:25104:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790391772.720486:0:25104:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2b1b7949f13e2cd7 00010000:00010000:1.0:1790391772.726751:0:25104:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1790391772.727780:0:25104:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:2.0:1790391772.740240:0:25104:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1790391772.742479:0:25104:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1790391772.742492:0:25104:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790391772.742499:0:25104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391772.742502:0:25104:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1790391772.742505:0:25104:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790391772.742510:0:25104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391772.742511:0:25104:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790391772.742514:0:25104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790391772.742516:0:25104:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790391772.742519:0:25104:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790391772.742521:0:25104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391772.742522:0:25104:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1790391772.742525:0:25104:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790391772.742527:0:25104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391772.742528:0:25104:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790391772.742955:0:25104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1790391772.742990:0:25104:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790391772.742994:0:25104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391772.742995:0:25104:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790391772.742999:0:25104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:0.0:1790391772.743214:0:25100:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1790391772.743252:0:25100:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1790391772.743276:0:25100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e518309c800/0x2b1b7949f13e2cc2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2cc9 expref: -99 pid: 25100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391772.743297:0:25100:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e518309c800/0x2b1b7949f13e2cc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2cc9 expref: -99 pid: 25100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391772.743305:0:25100:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e5284edc000 from 1 10000000:01000000:0.0:1790391772.743319:0:25100:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790391772.743357:0:25100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5280031800/0x2b1b7949f13e2cde lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391772.743365:0:25100:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e5280031800/0x2b1b7949f13e2cde lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391772.743376:0:25100:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e5280031800/0x2b1b7949f13e2cde lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391772.743400:0:25100:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183ba8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:25100:1877361186572544:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790391772.743470:0:25100:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391772.743523:0:25100:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528916eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1790391772.743744:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186572544 00000100:00100000:1.0:1790391772.743752:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186572544 00000100:00100000:1.0:1790391772.743808:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1790391772.743818:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+22:25100:x1877361186572544:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790391772.743830:0:22769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391772.743844:0:22769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5184054000/0x2b1b7949f13e2ce5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e2cde expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391772.743906:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5184054000/0x2b1b7949f13e2ce5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e2cde expref: 23 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391772.743917:0:22769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5184054000/0x2b1b7949f13e2ce5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2cde expref: 23 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391772.743926:0:22769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5184054000, rc 0) 00000100:00100000:1.0:1790391772.743984:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+23:25100:x1877361186572544:12345-0@lo:101:mount.lustre.0 Request processed in 168us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391772.743991:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1790391772.744322:0:25100:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183ba8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:25100:1877361186572544:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790391772.744338:0:25100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e5280031800/0x2b1b7949f13e2cde lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2ce5 expref: -99 pid: 25100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391772.744347:0:25100:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e5280031800/0x2b1b7949f13e2cde lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e2ce5 expref: -99 pid: 25100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790391772.748156:0:25100:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1790391772.748540:0:25100:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790391772.748719:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1790391772.748746:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1790391772.748780:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1790391772.748797:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1790391772.748810:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1790391772.748823:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1790391772.748837:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1790391772.750240:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1790391772.750291:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1790391772.750306:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1790391772.750320:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1790391772.750346:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1790391772.750352:0:25100:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1790391772.750449:0:25100:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf948a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:25100:1877361186572672:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790391772.750518:0:25100:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391772.750554:0:25100:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290b46780 going to sleep for 11 seconds 00000100:00100000:1.0:1790391772.751388:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186572672 00000100:00100000:1.0:1790391772.751397:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186572672 00000100:00100000:1.0:1790391772.751455:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790391772.751465:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+23:25100:x1877361186572672:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790391772.752031:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+23:25100:x1877361186572672:12345-0@lo:501:mount.lustre.0 Request processed in 566us (1511us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391772.752041:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1790391772.752901:0:25100:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf948a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:25100:1877361186572672:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790391772.752952:0:25100:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf948a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:25100:1877361186572800:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790391772.753003:0:25100:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391772.753034:0:25100:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290b46780 going to sleep for 11 seconds 00000100:00100000:1.0:1790391772.753447:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186572800 00000100:00100000:1.0:1790391772.753455:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186572800 00000100:00100000:1.0:1790391772.753937:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1790391772.753947:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+23:25100:x1877361186572800:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790391772.754081:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+23:25100:x1877361186572800:12345-0@lo:503:mount.lustre.0 Request processed in 135us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391772.754089:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790391772.754190:0:25100:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf948a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:25100:1877361186572800:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790391772.756804:0:25100:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790391772.756948:0:25100:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf948a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:25100:1877361186572928:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790391772.757024:0:25100:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391772.757068:0:25100:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290b46780 going to sleep for 11 seconds 00000100:00100000:1.0:1790391772.757195:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186572928 00000100:00100000:1.0:1790391772.757201:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186572928 00000100:00100000:1.0:1790391772.757284:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790391772.757293:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+23:25100:x1877361186572928:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790391772.757425:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+23:25100:x1877361186572928:12345-0@lo:502:mount.lustre.0 Request processed in 133us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391772.757433:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1790391772.757509:0:25100:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf948a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:25100:1877361186572928:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790391772.757712:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1790391772.757738:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1790391772.757766:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1790391772.757782:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1790391772.757795:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1790391772.757807:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1790391772.757818:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1790391772.757829:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1790391772.757852:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1790391772.757901:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1790391772.757917:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1790391772.757940:0:25100:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf948a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:25100:1877361186573056:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790391772.757976:0:25100:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391772.758533:0:25100:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290b46780 going to sleep for 11 seconds 00000100:00100000:3.0:1790391772.758564:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186573056 00000100:00100000:3.0:1790391772.758570:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186573056 00000100:00100000:3.0:1790391772.758599:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1790391772.758606:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+23:25100:x1877361186573056:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790391772.758741:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+23:25100:x1877361186573056:12345-0@lo:502:mount.lustre.0 Request processed in 134us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391772.758749:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1790391772.759005:0:25100:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf948a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:25100:1877361186573056:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790391772.759059:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1790391772.759069:0:25100:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1790391772.759763:0:25108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790391772.759773:0:25108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391772.759776:0:25108:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790391772.759963:0:25108:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e5284edc000 00000020:00000080:0.0:1790391772.759974:0:25108:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790391772.759983:0:25108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790391772.759986:0:25108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391772.759988:0:25108:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1790391772.759990:0:25108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790391772.760008:0:25108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391772.760010:0:25108:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790391772.760014:0:25108:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e5284edc000 00000020:00000080:0.0:1790391772.760016:0:25108:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790391772.760118:0:25108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790391772.760123:0:25108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391772.760125:0:25108:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1790391772.760127:0:25108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790391772.760131:0:25108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391772.760132:0:25108:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790391772.760136:0:25108:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e5284edc000 00000020:00000080:0.0:1790391772.760138:0:25108:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790391772.761478:0:25108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790391772.761486:0:25108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391772.761488:0:25108:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790391772.761491:0:25108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790391772.761495:0:25108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391772.761496:0:25108:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1790391772.761500:0:25108:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e5284edc000 00000020:00000080:0.0:1790391772.761502:0:25108:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790391772.761559:0:25108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790391772.761564:0:25108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391772.761565:0:25108:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1790391772.761672:0:25108:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1790391772.762176:0:25100:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1790391772.762205:0:25100:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790391772.762232:0:25100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5280031800/0x2b1b7949f13e2cde lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2ce5 expref: -99 pid: 25100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391772.762245:0:25100:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5280031800/0x2b1b7949f13e2cde lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2ce5 expref: -99 pid: 25100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391772.762302:0:25100:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790391772.762305:0:25100:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e5284edc000 10000000:01000000:2.0:1790391772.762309:0:25100:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e5284edc000 10000000:01000000:2.0:1790391772.762313:0:25100:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790391772.762319:0:25100:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e5284edc000 from 1 10000000:01000000:2.0:1790391772.762323:0:25100:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790391772.762362:0:25100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e518309ca00/0x2b1b7949f13e2cec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391772.762372:0:25100:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e518309ca00/0x2b1b7949f13e2cec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391772.762383:0:25100:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e518309ca00/0x2b1b7949f13e2cec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391772.762416:0:25100:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf948a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:25100:1877361186573184:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790391772.762487:0:25100:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391772.762534:0:25100:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290b469c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391772.762548:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186573184 00000100:00100000:1.0:1790391772.762555:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186573184 00000100:00100000:1.0:1790391772.762613:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790391772.762629:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+23:25100:x1877361186573184:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790391772.762641:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391772.762654:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5184055600/0x2b1b7949f13e2cf3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e2cec expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391772.762677:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5184055600/0x2b1b7949f13e2cf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e2cec expref: 24 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391772.762687:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5184055600/0x2b1b7949f13e2cf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2cec expref: 24 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391772.762706:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5184055600, rc 0) 00000100:00100000:1.0:1790391772.762741:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+24:25100:x1877361186573184:12345-0@lo:101:mount.lustre.0 Request processed in 114us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391772.762747:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1790391772.763197:0:25100:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf948a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:25100:1877361186573184:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790391772.763211:0:25100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e518309ca00/0x2b1b7949f13e2cec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2cf3 expref: -99 pid: 25100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391772.763221:0:25100:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e518309ca00/0x2b1b7949f13e2cec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e2cf3 expref: -99 pid: 25100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790391772.765306:0:25100:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1790391772.766214:0:25100:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790391772.766805:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1790391772.766840:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1790391772.766873:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1790391772.766923:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1790391772.766937:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1790391772.766951:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1790391772.766986:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1790391772.767004:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1790391772.767021:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1790391772.767036:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1790391772.767051:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1790391772.767065:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1790391772.767080:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1790391772.767095:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1790391772.767107:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1790391772.767119:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1790391772.767131:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1790391772.767172:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1790391772.767190:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1790391772.767204:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1790391772.767222:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1790391772.767238:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1790391772.767273:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1790391772.767313:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1790391772.767336:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1790391772.767357:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1790391772.767377:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1790391772.767390:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1790391772.767405:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1790391772.767418:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1790391772.767431:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1790391772.769032:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1790391772.769057:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1790391772.769073:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1790391772.769093:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1790391772.769110:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1790391772.769126:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1790391772.770595:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1790391772.770711:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1790391772.770734:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1790391772.770749:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1790391772.770762:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1790391772.770775:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1790391772.770791:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1790391772.770805:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1790391772.770818:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1790391772.770832:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1790391772.770844:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1790391772.771109:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1790391772.771134:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1790391772.774062:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1790391772.774079:0:25100:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1790391772.774425:0:25100:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf948a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:25100:1877361186573312:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790391772.775251:0:25100:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391772.775322:0:25100:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290b46840 going to sleep for 11 seconds 00000100:00100000:1.0:1790391772.775506:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186573312 00000100:00100000:1.0:1790391772.775524:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186573312 00000100:00100000:1.0:1790391772.775602:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790391772.775613:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+24:25100:x1877361186573312:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790391772.775796:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+24:25100:x1877361186573312:12345-0@lo:501:mount.lustre.0 Request processed in 171us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391772.775805:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790391772.776792:0:25100:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf948a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:25100:1877361186573312:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790391772.776908:0:25100:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf948a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:25100:1877361186573440:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790391772.776995:0:25100:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391772.777045:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186573440 00000100:00100000:2.0:1790391772.777052:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186573440 00000100:00100000:2.0:1790391772.777114:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1790391772.777124:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+24:25100:x1877361186573440:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790391772.778701:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+24:25100:x1877361186573440:12345-0@lo:503:mount.lustre.0 Request processed in 1567us (1694us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391772.778718:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1790391772.778817:0:25100:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290b46840 going to sleep for 11 seconds 00000100:00100000:2.0:1790391772.778851:0:25100:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf948a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:25100:1877361186573440:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790391772.782951:0:25100:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790391772.783134:0:25100:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf948a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:25100:1877361186573568:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790391772.783253:0:25100:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391772.783326:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186573568 00000100:00100000:2.0:1790391772.783336:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186573568 00000100:00100000:2.0:1790391772.783410:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790391772.783426:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+24:25100:x1877361186573568:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790391772.783952:0:25100:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290b469c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391772.784851:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+24:25100:x1877361186573568:12345-0@lo:502:mount.lustre.0 Request processed in 1423us (1592us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391772.784949:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1790391772.785385:0:25100:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf948a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:25100:1877361186573568:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790391772.785677:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1790391772.785732:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1790391772.785748:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1790391772.785775:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1790391772.785790:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1790391772.785803:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1790391772.785817:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1790391772.785831:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1790391772.785845:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1790391772.785871:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1790391772.785930:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1790391772.785947:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1790391772.785960:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1790391772.785976:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1790391772.786005:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1790391772.786020:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1790391772.786033:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1790391772.786046:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1790391772.786060:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1790391772.786073:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1790391772.786087:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1790391772.786102:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1790391772.786115:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1790391772.786129:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1790391772.786142:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1790391772.786154:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1790391772.786180:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1790391772.786196:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1790391772.786210:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1790391772.786223:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1790391772.786237:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1790391772.786250:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1790391772.786263:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1790391772.786274:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1790391772.786292:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1790391772.786303:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1790391772.786313:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1790391772.786325:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1790391772.786338:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1790391772.786351:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1790391772.786362:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1790391772.786375:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1790391772.786398:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1790391772.786412:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1790391772.786427:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1790391772.786441:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1790391772.786454:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1790391772.786465:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1790391772.786517:0:25100:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183ba8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:25100:1877361186573696:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790391772.786598:0:25100:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391772.786653:0:25100:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290b469c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391772.786697:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186573696 00000100:00100000:2.0:1790391772.786711:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186573696 00000100:00100000:2.0:1790391772.786789:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1790391772.786802:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+24:25100:x1877361186573696:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790391772.787016:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+24:25100:x1877361186573696:12345-0@lo:502:mount.lustre.0 Request processed in 215us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391772.787025:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1790391772.788085:0:25100:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183ba8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:25100:1877361186573696:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790391772.788284:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1790391772.788310:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1790391772.788344:0:25100:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183ba8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:25100:1877361186573824:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790391772.788418:0:25100:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391772.788456:0:25100:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290b469c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391772.788589:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186573824 00000100:00100000:2.0:1790391772.788601:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186573824 00000100:00100000:2.0:1790391772.788672:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1790391772.788685:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+24:25100:x1877361186573824:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790391772.788874:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+24:25100:x1877361186573824:12345-0@lo:502:mount.lustre.0 Request processed in 190us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391772.788913:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1790391772.788931:0:25100:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183ba8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:25100:1877361186573824:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790391772.789175:0:25100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1790391772.789185:0:25100:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1790391772.790103:0:25113:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1790391772.790119:0:25113:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9e529e978000) 00000020:00000080:0.0:1790391772.790145:0:25113:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1790391772.790353:0:25113:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e5284edc000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1790391772.790357:0:25113:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e5284edc000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1790391772.790360:0:25113:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e5284edc000 3 00010000:00080000:0.0:1790391772.790390:0:25113:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e528f6b0800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.128@tcp at head 00010000:00010000:2.0:1790391772.801625:0:25113:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1790391772.801821:0:25113:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1790391772.801906:0:25113:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790391772.801919:0:25113:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x2b1b7949f13e2d01 00000100:00080000:2.0:1790391772.801929:0:25113:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790391772.801935:0:25113:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e528f6b0800 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:2.0:1790391772.801972:0:25113:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e52bf948e00 x1877361186573952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790391772.802054:0:25113:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1790391772.804809:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1877361186573952:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790391772.804944:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391772.805142:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186573952 00000100:00100000:1.0:1790391772.805153:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186573952 00000100:00100000:1.0:1790391772.805200:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790391772.805209:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183ba8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1877361186573952:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1790391772.805237:0:22778:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 686 last 0 00000020:00000080:1.0:1790391772.805274:0:22778:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x2b1b7949f13e2d08 00000004:00100000:1.0:1790391772.805303:0:22778:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790391772.805339:0:22778:0:(import.c:65:import_set_state_nolock()) ffff9e52afc90000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790391772.805410:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183ba8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1877361186573952:12345-0@lo:38:llog_process_th.0 Request processed in 200us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391772.805417:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1790391772.805460:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e52bf948e00 x1877361186573952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790391782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391772.805472:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790391772.805481:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1790391772.805489:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1790391772.805494:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790391772.805497:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e528f6b0800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790391772.805503:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1877361186573952:0@lo:38:llog_process_th.0 00000020:01000004:2.0:1790391772.808222:0:25113:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1790391772.808247:0:25113:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9e51823b0000) 00000020:00000080:2.0:1790391772.808286:0:25113:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1790391772.808674:0:25113:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e5284edc000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1790391772.808680:0:25113:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e5284edc000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1790391772.808683:0:25113:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e5284edc000 3 00010000:00080000:2.0:1790391772.808755:0:25113:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e52b75c1800@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.128@tcp at head 00010000:00010000:2.0:1790391772.817506:0:25113:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1790391772.817947:0:25113:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1790391772.818213:0:25113:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790391772.818227:0:25113:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x2b1b7949f13e2d16 00000100:00080000:2.0:1790391772.818238:0:25113:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790391772.818245:0:25113:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9e52b75c1800 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:2.0:1790391772.818280:0:25113:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e52bf948000 x1877361186574080/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790391772.818308:0:25113:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1790391772.819515:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf948000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1877361186574080:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790391772.819594:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391772.819718:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186574080 00000100:00100000:3.0:1790391772.819727:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186574080 00000100:00100000:3.0:1790391772.819839:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790391772.819849:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518331ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1877361186574080:12345-0@lo:38:llog_process_th.0 00000040:00080000:2.0:1790391772.819927:0:25113:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00010000:00080000:3.0:1790391772.819939:0:22777:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 686 last 0 00000020:01000000:2.0:1790391772.819976:0:25100:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 00000020:00000080:3.0:1790391772.819977:0:22777:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x2b1b7949f13e2d1d 00000004:00100000:3.0:1790391772.819995:0:22777:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 10000000:01000000:2.0:1790391772.820016:0:25100:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790391772.820030:0:25100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e518309ca00/0x2b1b7949f13e2cec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2cf3 expref: -99 pid: 25100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1790391772.820032:0:22777:0:(import.c:65:import_set_state_nolock()) ffff9e5182c60000 : changing import state from RECOVER to FULL 00010000:00010000:2.0:1790391772.820053:0:25100:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e518309ca00/0x2b1b7949f13e2cec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2cf3 expref: -99 pid: 25100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391772.820094:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518331ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1877361186574080:12345-0@lo:38:llog_process_th.0 Request processed in 245us (500us total) trans 0 rc 0/0 00000020:01000004:2.0:1790391772.820097:0:25100:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790391772.820100:0:25100:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790391772.820103:0:25100:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790391772.820104:0:25100:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790391772.820106:0:25100:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000100:00100000:3.0:1790391772.820107:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000020:01000004:2.0:1790391772.820109:0:25100:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790391772.820112:0:25100:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790391772.820114:0:25100:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790391772.820119:0:25100:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790391772.820124:0:25100:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1790391772.820127:0:25100:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790391772.820129:0:25100:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790391772.820130:0:25100:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790391772.820131:0:25100:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790391772.820132:0:25100:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790391772.820141:0:25100:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790391772.820143:0:25100:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790391772.820144:0:25100:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790391772.820145:0:25100:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00080000:3.0:1790391772.820164:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e52bf948000 x1877361186574080/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790391782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1790391772.820165:0:25100:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1790391772.820177:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00100000:2.0:1790391772.820181:0:25100:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:25100:1877361186574208:0@lo:253:mount.lustre.0 00000100:00080000:3.0:1790391772.820187:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1790391772.820196:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1790391772.820201:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1790391772.820203:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e52b75c1800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790391772.820210:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf948000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1877361186574080:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790391772.820228:0:25100:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391772.820246:0:25100:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52903826c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391772.821938:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186574208 00000100:00100000:0.0:1790391772.821948:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186574208 00000100:00100000:0.0:1790391772.822006:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1790391772.822015:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+24:25100:x1877361186574208:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790391772.822044:0:22770:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1790391772.822057:0:22770:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1790391772.829148:0:22770:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790391772.829170:0:22770:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1790391772.829279:0:22792:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790391772.829285:0:22792:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790391772.829308:0:22792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e52bab9d800/0x2b1b7949f13e2d24 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391772.829326:0:22792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e52bab9de00/0x2b1b7949f13e2bb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2bb1 expref: 24 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391772.829335:0:22792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e518309cc00/0x2b1b7949f13e2bc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2bbf expref: 24 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391772.829343:0:22792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e52bab9d800/0x2b1b7949f13e2d24 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391772.829393:0:22792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e518309cc00/0x2b1b7949f13e2bc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e2bbf expref: 24 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391772.829407:0:22792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e518309cc00/0x2b1b7949f13e2bc6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e2bbf expref: 24 pid: 22769 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391772.829421:0:22792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb398a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22792:1877361186574336:0@lo:104: 00000100:00100000:3.0:1790391772.829493:0:22792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790391772.829546:0:22792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e52bab9de00/0x2b1b7949f13e2bb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e2bb1 expref: 24 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391772.829554:0:22792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e52bab9de00/0x2b1b7949f13e2bb8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e2bb1 expref: 24 pid: 22771 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391772.829561:0:22792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb39a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22792:1877361186574464:0@lo:104: 00000100:00100000:3.0:1790391772.829583:0:22792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391772.829610:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529055df00 going to sleep for 11 seconds 00000100:00100000:2.0:1790391772.829668:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186574336 00000100:00100000:2.0:1790391772.829676:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186574336 00000100:00100000:2.0:1790391772.829721:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186574464 00000100:00100000:2.0:1790391772.829725:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186574464 00000100:00100000:2.0:1790391772.829738:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790391772.829747:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bb39aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e907dcd1-fffe-43bb-853f-376b925bb229+4:22792:x1877361186574336:12345-0@lo:104: 00010000:00010000:2.0:1790391772.829769:0:22760:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e5295144800/0x2b1b7949f13e2bbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e2bc6 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391772.829834:0:22760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790391772.829841:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bb39aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e907dcd1-fffe-43bb-853f-376b925bb229+4:22792:x1877361186574336:12345-0@lo:104: Request processed in 95us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391772.829848:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790391772.829897:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790391772.829905:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bb398700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e907dcd1-fffe-43bb-853f-376b925bb229+3:22792:x1877361186574464:12345-0@lo:104: 00010000:00010000:2.0:1790391772.829923:0:22760:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e2bb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e2bb8 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391772.829960:0:22760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790391772.829964:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bb398700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e907dcd1-fffe-43bb-853f-376b925bb229+3:22792:x1877361186574464:12345-0@lo:104: Request processed in 60us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391772.829969:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790391772.830172:0:22792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb398a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22792:1877361186574336:0@lo:104: 00000100:00100000:3.0:1790391772.830181:0:22792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb39a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22792:1877361186574464:0@lo:104: 00010000:00010000:3.0:1790391772.830200:0:22792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e52bab9d800/0x2b1b7949f13e2d24 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391772.830264:0:24815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790391772.830271:0:24815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e5295144800/0x2b1b7949f13e2bbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e2bc6 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391772.830278:0:24815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295144800 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:1.0:1790391772.830282:0:24815:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e5295144800/0x2b1b7949f13e2bbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e2bc6 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391772.830291:0:24815:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5295144800/0x2b1b7949f13e2bbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e2bc6 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391772.830298:0:24815:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5295144800/0x2b1b7949f13e2bbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e2bc6 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391772.830313:0:24815:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790391772.830355:0:24815:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e5295144800/0x2b1b7949f13e2bbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e2bc6 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391772.830363:0:24815:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790391772.830390:0:24815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e5295144800/0x2b1b7949f13e2bbf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e2bc6 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391772.830397:0:24815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5295144800/0x2b1b7949f13e2bbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e2bc6 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391772.830410:0:24815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391772.830414:0:24815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e2bb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e2bb8 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391772.830420:0:24815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295144600 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:1.0:1790391772.830423:0:24815:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e2bb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e2bb8 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391772.830429:0:24815:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e2bb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e2bb8 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391772.830436:0:24815:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e2bb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e2bb8 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391772.830441:0:24815:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790391772.830454:0:24815:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e2bb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e2bb8 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391772.830460:0:24815:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790391772.830484:0:24815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e2bb1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e2bb8 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391772.830491:0:24815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e2bb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e2bb8 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391772.830504:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391772.830505:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391772.830507:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391772.830516:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790391772.830528:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e907dcd1-fffe-43bb-853f-376b925bb229:3637:1877361186574592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790391772.830562:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391772.830590:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e907dcd1-fffe-43bb-853f-376b925bb229:3639:1877361186574720:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790391772.830628:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391772.830664:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186574592 00000100:00100000:1.0:1790391772.830669:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186574592 00010000:00010000:1.0:1790391772.830688:0:22763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e518309cc00/0x2b1b7949f13e2bc6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e2bbf expref: 25 pid: 22769 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391772.830896:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186574720 00000100:00100000:1.0:1790391772.830901:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186574720 00010000:00010000:1.0:1790391772.830915:0:22763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e52bab9de00/0x2b1b7949f13e2bb8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e2bb1 expref: 26 pid: 22771 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391772.830930:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790391772.830936:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e907dcd1-fffe-43bb-853f-376b925bb229+26:3637:x1877361186574592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790391772.830948:0:22763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391772.830953:0:22763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e518309cc00/0x2b1b7949f13e2bc6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e2bbf expref: 26 pid: 22769 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391772.830976:0:22763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e518309cc00/0x2b1b7949f13e2bc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e2bbf expref: 26 pid: 22769 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391772.830989:0:22763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e518309cc00/0x2b1b7949f13e2bc6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e2bbf expref: 26 pid: 22769 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391772.831000:0:22763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391772.831031:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e907dcd1-fffe-43bb-853f-376b925bb229+25:3637:x1877361186574592:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391772.831037:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790391772.831052:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790391772.831058:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e907dcd1-fffe-43bb-853f-376b925bb229+24:3639:x1877361186574720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790391772.831066:0:22763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391772.831071:0:22763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e52bab9de00/0x2b1b7949f13e2bb8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e2bb1 expref: 24 pid: 22771 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391772.831079:0:22763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e52bab9de00/0x2b1b7949f13e2bb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e2bb1 expref: 24 pid: 22771 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391772.831088:0:22763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52bab9de00/0x2b1b7949f13e2bb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e2bb1 expref: 24 pid: 22771 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391772.831099:0:22763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e52bab9d800/0x2b1b7949f13e2d24 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391772.831107:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52bab9d800/0x2b1b7949f13e2d24 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790391772.831121:0:22763:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013940840s 00010000:00010000:1.0:1790391772.831132:0:22763:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e52bab9d800/0x2b1b7949f13e2d24 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391772.831139:0:22763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e52bab9d800/0x2b1b7949f13e2d24 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391772.831146:0:22763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e52bab9d800/0x2b1b7949f13e2d24 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391772.831152:0:22763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e52bab9d800/0x2b1b7949f13e2d24 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391772.831156:0:22763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52bab9d800 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:1.0:1790391772.831160:0:22763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e52bab9d800/0x2b1b7949f13e2d24 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391772.831168:0:22763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e52bab9d800/0x2b1b7949f13e2d24 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391772.831183:0:22763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e52bab9d800/0x2b1b7949f13e2d24 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391772.831194:0:22763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391772.831221:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e907dcd1-fffe-43bb-853f-376b925bb229+23:3639:x1877361186574720:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391772.831227:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790391772.831258:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e907dcd1-fffe-43bb-853f-376b925bb229:3639:1877361186574720:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790391772.831281:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e907dcd1-fffe-43bb-853f-376b925bb229:3637:1877361186574592:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790391772.831296:0:22792:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e52bab9d800/0x2b1b7949f13e2d24 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391772.831314:0:22792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e52bab9d800/0x2b1b7949f13e2d24 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391772.831320:0:22792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52bab9d800/0x2b1b7949f13e2d24 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391772.831570:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391772.832036:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+22:25100:x1877361186574208:12345-0@lo:253:mount.lustre.0 Request processed in 10020us (11807us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391772.832047:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1790391772.832127:0:25100:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e907dcd1-fffe-43bb-853f-376b925bb229:25100:1877361186574208:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790391772.832138:0:25100:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1790391772.832142:0:25100:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790391772.832144:0:25100:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790391772.832145:0:25100:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790391772.832146:0:25100:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790391772.832147:0:25100:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790391772.832148:0:25100:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790391772.832150:0:25100:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790391772.832151:0:25100:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790391772.832153:0:25100:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790391772.832168:0:25100:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:2.0:1790391772.839223:0:25100:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1790391772.848943:0:25100:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1790391772.848955:0:25100:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1790391772.848998:0:25100:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1790391772.849046:0:25100:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.128@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1790391772.849073:0:25100:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1790391772.849105:0:25100:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1790391772.849958:0:25100:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790391772.850189:0:25100:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790391773.003512:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1790391773.895262:0:25167:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790391773.895487:0:25167:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1790391773.900568:0:23532:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790391774.024101:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790391774.794582:0:22810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1790391774.799229:0:22773:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790391774.799237:0:22773:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e5284985000 from 14 10000000:01000000:1.0:1790391774.799243:0:22773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790391774.799290:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5184055400/0x2b1b7949f13e2d2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391774.799303:0:22773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e5184055400/0x2b1b7949f13e2d2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391774.799314:0:22773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e5184055400/0x2b1b7949f13e2d2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391774.799341:0:22773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186574848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790391774.799405:0:22773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391774.799454:0:22773:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a0cedc00 going to sleep for 11 seconds 00000100:00100000:3.0:1790391774.801063:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186574848 00000100:00100000:3.0:1790391774.801076:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186574848 00000100:00100000:3.0:1790391774.801153:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790391774.801164:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+22:22773:x1877361186574848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391774.801179:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391774.801197:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52bab9c600/0x2b1b7949f13e2d32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e2d2b expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391774.801222:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52bab9c600/0x2b1b7949f13e2d32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e2d2b expref: 23 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391774.801234:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52bab9c600/0x2b1b7949f13e2d32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2d2b expref: 23 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391774.801244:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52bab9c600, rc 0) 00000100:00100000:3.0:1790391774.801318:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+23:22773:x1877361186574848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (1912us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391774.801324:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1790391774.801495:0:22773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186574848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790391774.801515:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e5184055400/0x2b1b7949f13e2d2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2d32 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391774.801524:0:22773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e5184055400/0x2b1b7949f13e2d2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e2d32 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391774.801605:0:22773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186574976:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1790391774.801643:0:22773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391774.801680:0:22773:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a0cedc00 going to sleep for 11 seconds 00000100:00100000:3.0:1790391774.802858:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186574976 00000100:00100000:3.0:1790391774.802866:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186574976 00000100:00100000:3.0:1790391774.802938:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790391774.802946:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+23:22773:x1877361186574976:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1790391774.802965:0:22770:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790391774.802984:0:22770:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790391774.802987:0:22770:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:3.0:1790391774.803086:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+23:22773:x1877361186574976:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 141us (1443us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391774.803098:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1790391774.803240:0:22773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186574976:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1790391774.803307:0:22773:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790391774.803315:0:22773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5184055400/0x2b1b7949f13e2d2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2d32 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391774.803324:0:22773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5184055400/0x2b1b7949f13e2d2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2d32 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391774.803334:0:22773:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790391774.803337:0:22773:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e52b56dd000 from 14 10000000:01000000:1.0:1790391774.803339:0:22773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790391774.803366:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5184054800/0x2b1b7949f13e2d39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391774.803374:0:22773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e5184054800/0x2b1b7949f13e2d39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391774.803382:0:22773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e5184054800/0x2b1b7949f13e2d39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391774.803398:0:22773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186575104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790391774.803426:0:22773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391774.803452:0:22773:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a0cedc00 going to sleep for 11 seconds 00000100:00100000:1.0:1790391774.803465:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186575104 00000100:00100000:1.0:1790391774.803475:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186575104 00000100:00100000:1.0:1790391774.803499:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1790391774.803505:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+23:22773:x1877361186575104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790391774.803513:0:22769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391774.803523:0:22769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5184054200/0x2b1b7949f13e2d40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e2d39 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391774.803542:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5184054200/0x2b1b7949f13e2d40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e2d39 expref: 24 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391774.803552:0:22769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5184054200/0x2b1b7949f13e2d40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2d39 expref: 24 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391774.803560:0:22769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5184054200, rc 0) 00000100:00100000:1.0:1790391774.803602:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+24:22773:x1877361186575104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391774.803608:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1790391774.803636:0:22773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186575104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790391774.803647:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e5184054800/0x2b1b7949f13e2d39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2d40 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391774.803656:0:22773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e5184054800/0x2b1b7949f13e2d39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e2d40 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391774.803695:0:22773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186575232:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1790391774.803724:0:22773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391774.803738:0:22773:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a0cedc00 going to sleep for 11 seconds 00000100:00100000:1.0:1790391774.803749:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186575232 00000100:00100000:1.0:1790391774.803757:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186575232 00000100:00100000:1.0:1790391774.803774:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1790391774.803780:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+24:22773:x1877361186575232:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1790391774.803789:0:22769:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790391774.803800:0:22769:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790391774.803803:0:22769:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1790391774.803896:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+24:22773:x1877361186575232:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 97us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391774.803903:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1790391774.803931:0:22773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186575232:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1790391774.803964:0:22773:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790391774.803969:0:22773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5184054800/0x2b1b7949f13e2d39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2d40 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391774.803977:0:22773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5184054800/0x2b1b7949f13e2d39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2d40 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391775.050740:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391776.072175:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391776.776444:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790391776.777981:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790391776.778013:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf948700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186575488:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790391776.778112:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391776.778224:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186575488 00000100:00100000:2.0:1790391776.778235:0:22781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186575488 00000100:00100000:2.0:1790391776.778302:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790391776.778313:0:22781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183ba9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186575488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790391776.778359:0:22781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1790391776.778438:0:22781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183ba9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186575488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391776.778445:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790391776.778579:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf948700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186575488:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790391776.780469:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186575360:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790391776.780559:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391776.780691:0:24287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186575360 00000100:00100000:3.0:1790391776.780702:0:24287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186575360 00000100:00100000:3.0:1790391776.780790:0:24287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790391776.780800:0:24287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186575360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790391776.780849:0:24287:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1790391776.780924:0:24287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186575360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 125us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391776.780932:0:24287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1790391776.781460:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790391776.781516:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186575360:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1790391777.107421:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391777.289458:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf949880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186575616:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790391777.289563:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391777.289684:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186575616 00000100:00100000:2.0:1790391777.289695:0:22781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186575616 00000100:00100000:2.0:1790391777.289780:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790391777.289792:0:22781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183ba9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186575616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790391777.289851:0:22781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790391777.289966:0:22781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183ba9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186575616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 176us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391777.289974:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790391777.290074:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf949880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186575616:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790391777.800167:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186575744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790391777.800267:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391777.800363:0:24287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186575744 00000100:00100000:1.0:1790391777.800375:0:24287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186575744 00000100:00100000:1.0:1790391777.800461:0:24287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790391777.800496:0:24287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186575744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790391777.800535:0:24287:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1790391777.800592:0:24287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186575744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391777.800600:0:24287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1790391777.800628:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790391777.800681:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186575744:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790391778.122075:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790391778.312453:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790391778.312469:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790391778.312472:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e528493c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790391778.312481:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 686 00000100:00080000:0.0:1790391778.312486:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1790391778.312493:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e528493c000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:0.0:1790391778.312517:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5183ba9880 x1877361186576128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790391778.312550:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790391778.312554:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790391778.312555:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e52b5cbb800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790391778.312558:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 686 00000100:00080000:0.0:1790391778.312560:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1790391778.312563:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e52b5cbb800 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:0.0:1790391778.312572:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5183baa300 x1877361186576640/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790391778.312621:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877361186576256:0@lo:400:kworker.0 00000100:00100000:0.0:1790391778.312701:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391778.312732:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1877361186576896:0@lo:400:kworker.0 00000100:00100000:0.0:1790391778.312753:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391778.312772:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1790391778.312778:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186576000:0@lo:400:kworker.0 00000100:00100000:0.0:1790391778.312800:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391778.312836:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183babb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877361186576768:0@lo:400:kworker.0 00000100:00100000:0.0:1790391778.312857:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391778.312911:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1877361186577280:0@lo:400:kworker.0 00000100:00100000:0.0:1790391778.312942:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391778.312970:0:23840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186576256 00000100:00100000:0.0:1790391778.312977:0:23840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186576256 00000100:00100000:0.0:1790391778.313011:0:23840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186576896 00000100:00100000:0.0:1790391778.313014:0:23840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186576896 00000100:00100000:1.0:1790391778.313321:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183ba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186576384:0@lo:400:kworker.0 00000100:00100000:1.0:1790391778.313354:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391778.313376:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1877361186577024:0@lo:400:kworker.0 00000100:00100000:1.0:1790391778.313505:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391778.313520:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1790391778.313527:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183ba8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e907dcd1-fffe-43bb-853f-376b925bb229:3639:1877361186575872:0@lo:400:kworker.0 00000100:00100000:1.0:1790391778.313553:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391778.313577:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183ba8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186576512:0@lo:400:kworker.0 00000100:00100000:1.0:1790391778.313598:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391778.313617:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1877361186577152:0@lo:400:kworker.0 00000100:00100000:1.0:1790391778.313636:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391778.313656:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186576768 00000100:00100000:1.0:1790391778.313660:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186576768 00000100:00100000:0.0:1790391778.313745:0:23840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186577280 00000100:00100000:0.0:1790391778.313749:0:23840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186577280 00000100:00100000:0.0:1790391778.313765:0:23840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186577024 00000100:00100000:0.0:1790391778.313767:0:23840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186577024 00000100:00100000:0.0:1790391778.313777:0:23840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186577152 00000100:00100000:0.0:1790391778.313779:0:23840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186577152 00000100:00100000:0.0:1790391778.313794:0:23840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790391778.313801:0:23840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877361186576256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391778.313863:0:23840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877361186576256:12345-0@lo:400:kworker.0 Request processed in 61us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391778.313870:0:23840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790391778.313906:0:23840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790391778.313912:0:23840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877361186576768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391778.313940:0:23840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877361186576768:12345-0@lo:400:kworker.0 Request processed in 28us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391778.313947:0:23840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790391778.313960:0:23840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790391778.313966:0:23840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877361186576896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391778.313991:0:23840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877361186576896:12345-0@lo:400:kworker.0 Request processed in 26us (1237us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391778.313997:0:23840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790391778.314008:0:23840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790391778.314023:0:23840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877361186577280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391778.314326:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790391778.314334:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877361186577024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391778.314372:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877361186577024:12345-0@lo:400:kworker.0 Request processed in 39us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391778.315512:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790391778.315539:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790391778.315548:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1877361186577152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391778.315606:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1877361186577152:12345-0@lo:400:kworker.0 Request processed in 60us (1968us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391778.315612:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790391778.315641:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186576000 00000100:00100000:1.0:1790391778.315647:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186576000 00000100:00100000:1.0:1790391778.315673:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186576384 00000100:00100000:1.0:1790391778.316955:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186576384 00000100:00100000:1.0:1790391778.316998:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790391778.317008:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186576000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391778.317174:0:23840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877361186577280:12345-0@lo:400:kworker.0 Request processed in 3150us (4229us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391778.317183:0:23840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790391778.317214:0:24284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186576512 00000100:00100000:0.0:1790391778.317218:0:24284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186576512 00000100:00100000:0.0:1790391778.317256:0:24284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790391778.317263:0:24284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186576512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391778.317295:0:24284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186576512:12345-0@lo:400:kworker.0 Request processed in 33us (3696us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391778.317302:0:24284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790391778.317477:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183babb80 x1877361186576768/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391778.317492:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183babb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877361186576768:0@lo:400:kworker.0 00010000:00080000:0.0:1790391778.317504:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51838f6680 x1877361186577280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391778.317512:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1877361186577280:0@lo:400:kworker.0 00010000:00080000:0.0:1790391778.317523:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183bab100 x1877361186576256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391778.317530:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877361186576256:0@lo:400:kworker.0 00010000:00080000:0.0:1790391778.317541:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51838f7800 x1877361186576896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391778.317547:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1877361186576896:0@lo:400:kworker.0 00000100:00100000:1.0:1790391778.317857:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186576000:12345-0@lo:400:kworker.0 Request processed in 849us (5054us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391778.317865:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790391778.317937:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790391778.317948:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186576384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391778.317985:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183ba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186576128:0@lo:8:kworker.0 00000100:00100000:1.0:1790391778.317989:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186576384:12345-0@lo:400:kworker.0 Request processed in 41us (4631us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391778.318007:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790391778.318082:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391778.318127:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183baa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186576640:0@lo:8:kworker.0 00000100:00100000:3.0:1790391778.318152:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391778.318210:0:24285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186576128 00000100:00100000:3.0:1790391778.318218:0:24285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186576128 00000100:00100000:3.0:1790391778.318252:0:24285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186576640 00000100:00100000:3.0:1790391778.318256:0:24285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186576640 00000100:00100000:3.0:1790391778.318268:0:24285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790391778.318276:0:24285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bb39a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3636:x1877361186576128:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1790391778.318314:0:24285:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 691 last 0 00000020:00000080:3.0:1790391778.318352:0:24285:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2b1b7949f13e2d47 00002000:00100000:3.0:1790391778.318371:0:24285:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9e5182c62000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1790391778.318375:0:24285:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1790391778.318397:0:24285:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1790391778.318666:0:24285:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1790391778.318703:0:24285:0:(import.c:65:import_set_state_nolock()) ffff9e5182c63000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790391778.318763:0:24285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bb39a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3636:x1877361186576128:12345-0@lo:8:kworker.0 Request processed in 486us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391778.318771:0:24285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790391778.318817:0:24285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790391778.318822:0:24285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bb398a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3636:x1877361186576640:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1790391778.318839:0:24285:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 691 last 0 00000020:00000080:3.0:1790391778.318858:0:24285:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2b1b7949f13e2d4e 00002000:00100000:3.0:1790391778.318864:0:24285:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9e5182c67000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1790391778.318869:0:24285:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1790391778.318872:0:24285:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1790391778.318937:0:24285:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1790391778.318952:0:24285:0:(import.c:65:import_set_state_nolock()) ffff9e5182c64000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790391778.318981:0:24285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bb398a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3636:x1877361186576640:12345-0@lo:8:kworker.0 Request processed in 157us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391778.318987:0:24285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1790391778.319042:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183ba9880 x1877361186576128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790391803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391778.319053:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790391778.319063:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1790391778.319073:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1790391778.319080:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1790391778.319082:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e528493c000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1790391778.319105:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1790391778.319110:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183ba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186576128:0@lo:8:kworker.0 00010000:00080000:3.0:1790391778.319138:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183baa300 x1877361186576640/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790391803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790391778.319139:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790391778.319152:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790391778.319153:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790391778.319162:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1790391778.319163:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790391778.319175:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1790391778.319181:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1790391778.319183:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e52b5cbb800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1790391778.319208:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1790391778.319209:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186575872 00000100:00100000:3.0:1790391778.319215:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183baa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186576640:0@lo:8:kworker.0 00000100:00100000:1.0:1790391778.319221:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186575872 00000100:00100000:1.0:1790391778.319303:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000004:00080000:3.0:1790391778.319313:0:22803:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1790391778.319316:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7674050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+24:3639:x1877361186575872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391778.319345:0:22803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cba680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22803:1877361186577536:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1790391778.320270:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186577408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790391778.324044:0:22803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391778.324101:0:22803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a7638300 going to sleep for 11 seconds 00000004:00080000:3.0:1790391778.324197:0:23521:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1790391778.324234:0:23521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cba300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23521:1877361186577792:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1790391778.324285:0:23521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391778.324301:0:23521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528776c900 going to sleep for 11 seconds 00000100:00100000:3.0:1790391778.324441:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790391778.324457:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186577664:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790391778.324488:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391778.324534:0:24766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186577536 00000100:00100000:3.0:1790391778.324543:0:24766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186577536 00000100:00100000:3.0:1790391778.324611:0:24766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186577792 00000100:00100000:3.0:1790391778.324614:0:24766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186577792 00000100:00100000:3.0:1790391778.324641:0:24766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790391778.324650:0:24766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22803:x1877361186577536:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1790391778.325407:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391778.325500:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186576000:0@lo:400:kworker.0 00000100:00100000:1.0:1790391778.327619:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7674050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+24:3639:x1877361186575872:12345-0@lo:400:kworker.0 Request processed in 8298us (14055us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391778.327634:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1790391778.327696:0:24288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186577664 00000100:00100000:1.0:1790391778.327705:0:24288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186577664 00000100:00100000:1.0:1790391778.327734:0:24288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186577408 00000100:00100000:1.0:1790391778.327738:0:24288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186577408 00000100:00100000:1.0:1790391778.327752:0:24288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790391778.327759:0:24288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3640:x1877361186577664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790391778.327792:0:24288:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1790391778.327872:0:24288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3640:x1877361186577664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 112us (3382us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391778.327893:0:24288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790391778.327906:0:24288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790391778.327912:0:24288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1877361186577408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790391778.327922:0:24288:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1790391778.327956:0:24288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1877361186577408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (2558us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391778.327963:0:24288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000004:00080000:1.0:1790391778.327983:0:22802:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1790391778.328079:0:22802:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691695200821ns, next at 0ns, rc = 0 00080000:00080000:1.0:1790391778.328085:0:22802:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1790391778.328107:0:23520:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1790391778.328144:0:23520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 691695266466ns, next at 0ns, rc = 0 00080000:00080000:1.0:1790391778.328148:0:23520:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1790391778.328442:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183ba8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e907dcd1-fffe-43bb-853f-376b925bb229:3639:1877361186575872:0@lo:400:kworker.0 00000100:00100000:1.0:1790391778.328460:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183ba8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186576512:0@lo:400:kworker.0 00010000:00080000:1.0:1790391778.328486:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51838f7100 x1877361186577152/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391778.328497:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1877361186577152:0@lo:400:kworker.0 00000100:00100000:1.0:1790391778.328509:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183ba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186576384:0@lo:400:kworker.0 00010000:00080000:1.0:1790391778.328521:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51838f5f80 x1877361186577024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391778.328586:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1877361186577024:0@lo:400:kworker.0 00010000:00080000:1.0:1790391778.328766:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5181cbb800 x1877361186577408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391794 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391778.328784:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186577408:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1790391778.330131:0:23510:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:1.0:1790391778.330170:0:22756:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1790391778.333675:0:24284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790391778.333707:0:24284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23521:x1877361186577792:12345-0@lo:7:osp-pre-1-1.0 00000100:00080000:2.0:1790391778.333795:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1790391778.333925:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5181cbad80 x1877361186577664/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391794 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391778.333964:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186577664:0@lo:13:osp-pre-1-1.0 00002000:00080000:3.0:1790391778.351627:0:24284:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1790391778.351637:0:24284:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1790391778.351833:0:24284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23521:x1877361186577792:12345-0@lo:7:osp-pre-1-1.0 Request processed in 18133us (27540us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391778.351846:0:24284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1790391778.354040:0:23521:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5181cba300 x1877361186577792/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790391794 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391778.354068:0:23521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cba300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23521:1877361186577792:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1790391778.354090:0:23521:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1790391778.354166:0:23521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf949c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23521:1877361186577920:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1790391778.354247:0:23521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391778.354298:0:23521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b7727600 going to sleep for 11 seconds 00000100:00100000:3.0:1790391778.356181:0:24285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186577920 00000100:00100000:3.0:1790391778.356200:0:24285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186577920 00000100:00100000:3.0:1790391778.356271:0:24285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790391778.356282:0:24285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf94ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23521:x1877361186577920:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1790391778.356318:0:24285:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:3.0:1790391778.356410:0:24285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf94ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23521:x1877361186577920:12345-0@lo:5:osp-pre-1-1.0 Request processed in 130us (2162us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391778.356417:0:24285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1790391778.356520:0:23521:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52bf949c00 x1877361186577920/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790391794 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391778.356538:0:23521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf949c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23521:1877361186577920:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1790391778.356551:0:23521:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1790391778.356601:0:23521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23521:1877361186578048:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1790391778.356638:0:23521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391778.356668:0:23521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5289f0cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1790391778.356869:0:24284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186578048 00000100:00100000:3.0:1790391778.356908:0:24284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186578048 00000100:00100000:3.0:1790391778.356944:0:24284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790391778.356952:0:24284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23521:x1877361186578048:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1790391778.356983:0:24284:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00080000:3.0:1790391778.357706:0:24766:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1790391778.357715:0:24766:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:3.0:1790391778.357720:0:24766:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:65) 00002000:00010000:3.0:1790391778.387316:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790391778.387328:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9c28db5/0x2b1b7949f13e2d55 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.387348:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=691s v=(0 0) 00010000:00010000:3.0:1790391778.387353:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391778.387370:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9c28db5/0x2b1b7949f13e2d55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.387407:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9c28db5/0x2b1b7949f13e2d55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.387419:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9c28db5/0x2b1b7949f13e2d55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.387427:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9c28db5/0x2b1b7949f13e2d55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.387454:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790391778.387795:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790391778.387800:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009a6a2c5/0x2b1b7949f13e2d5c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.388156:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=691s v=(0 0) 00010000:00010000:3.0:1790391778.388160:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391778.388165:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009a6a2c5/0x2b1b7949f13e2d5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.388344:0:22764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391778.388353:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9c28db5/0x2b1b7949f13e2d55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.388361:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52bab9d400 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:0.0:1790391778.388366:0:22764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9c28db5/0x2b1b7949f13e2d55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.388375:0:22764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9c28db5/0x2b1b7949f13e2d55 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.388405:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9c28db5/0x2b1b7949f13e2d55 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.388412:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9c28db5/0x2b1b7949f13e2d55 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.388448:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391778.388450:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391778.388452:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391778.388528:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009a6a2c5/0x2b1b7949f13e2d5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.388542:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009a6a2c5/0x2b1b7949f13e2d5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.388559:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009a6a2c5/0x2b1b7949f13e2d5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.391309:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790391778.391375:0:24815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391778.391405:0:24815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009a6a2c5/0x2b1b7949f13e2d5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.391420:0:24815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52bab9ca00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:3.0:1790391778.391427:0:24815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009a6a2c5/0x2b1b7949f13e2d5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.391440:0:24815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009a6a2c5/0x2b1b7949f13e2d5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.391464:0:24815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009a6a2c5/0x2b1b7949f13e2d5c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.391474:0:24815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009a6a2c5/0x2b1b7949f13e2d5c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.391509:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391778.391511:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391778.391513:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790391778.392039:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790391778.392052:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000344873b3/0x2b1b7949f13e2d63 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.392072:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=691s v=(0 0) 00010000:00010000:2.0:1790391778.392086:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391778.392095:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000344873b3/0x2b1b7949f13e2d63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.392114:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000344873b3/0x2b1b7949f13e2d63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.392125:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000344873b3/0x2b1b7949f13e2d63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.392134:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000344873b3/0x2b1b7949f13e2d63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.392159:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790391778.392995:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790391778.393007:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fac256e/0x2b1b7949f13e2d6a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.393021:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=691s v=(0 0) 00010000:00010000:2.0:1790391778.393026:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391778.393031:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fac256e/0x2b1b7949f13e2d6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.393044:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006fac256e/0x2b1b7949f13e2d6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.393054:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fac256e/0x2b1b7949f13e2d6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.393071:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006fac256e/0x2b1b7949f13e2d6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.393096:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1790391778.393639:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790391778.393648:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080a9de9c/0x2b1b7949f13e2d71 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.393659:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=691s v=(0 0) 00010000:00010000:2.0:1790391778.393663:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391778.393668:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080a9de9c/0x2b1b7949f13e2d71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.393679:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080a9de9c/0x2b1b7949f13e2d71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.393687:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080a9de9c/0x2b1b7949f13e2d71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.393695:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080a9de9c/0x2b1b7949f13e2d71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.393717:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1790391778.393997:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790391778.394004:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000797fd3e/0x2b1b7949f13e2d78 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.394021:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=691s v=(0 0) 00010000:00010000:2.0:1790391778.394024:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391778.394030:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000797fd3e/0x2b1b7949f13e2d78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.394042:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000797fd3e/0x2b1b7949f13e2d78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.394052:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000797fd3e/0x2b1b7949f13e2d78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.394060:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000797fd3e/0x2b1b7949f13e2d78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.394071:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1790391778.394245:0:24815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1790391778.394256:0:24815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000344873b3/0x2b1b7949f13e2d63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.394276:0:24815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309c200 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:3.0:1790391778.394282:0:24815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000344873b3/0x2b1b7949f13e2d63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.394293:0:24815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000344873b3/0x2b1b7949f13e2d63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.394313:0:24815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000344873b3/0x2b1b7949f13e2d63 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.394320:0:24815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000344873b3/0x2b1b7949f13e2d63 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.394343:0:24815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1790391778.394347:0:24815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006fac256e/0x2b1b7949f13e2d6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.394353:0:24815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309de00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:3.0:1790391778.394356:0:24815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006fac256e/0x2b1b7949f13e2d6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.394362:0:24815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006fac256e/0x2b1b7949f13e2d6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.394370:0:24815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006fac256e/0x2b1b7949f13e2d6a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.394549:0:24815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fac256e/0x2b1b7949f13e2d6a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.394566:0:24815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790391778.394570:0:24815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080a9de9c/0x2b1b7949f13e2d71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.394576:0:24815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309d800 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:3.0:1790391778.394579:0:24815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080a9de9c/0x2b1b7949f13e2d71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.394586:0:24815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080a9de9c/0x2b1b7949f13e2d71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.394595:0:24815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080a9de9c/0x2b1b7949f13e2d71 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.394602:0:24815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080a9de9c/0x2b1b7949f13e2d71 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.394615:0:24815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391778.394618:0:24815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000797fd3e/0x2b1b7949f13e2d78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.394624:0:24815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309cc00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:3.0:1790391778.394633:0:24815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000797fd3e/0x2b1b7949f13e2d78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.394640:0:24815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000797fd3e/0x2b1b7949f13e2d78 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.394649:0:24815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000797fd3e/0x2b1b7949f13e2d78 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.394787:0:24815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000797fd3e/0x2b1b7949f13e2d78 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.394814:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391778.394815:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391778.394817:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391778.394983:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391778.396789:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790391778.397915:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790391778.397934:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073163eee/0x2b1b7949f13e2d7f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.397963:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=691s v=(0 0) 00010000:00010000:2.0:1790391778.397970:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391778.397979:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073163eee/0x2b1b7949f13e2d7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.397999:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073163eee/0x2b1b7949f13e2d7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.398024:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073163eee/0x2b1b7949f13e2d7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.398033:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073163eee/0x2b1b7949f13e2d7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.398063:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790391778.398767:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790391778.398779:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f58ee29/0x2b1b7949f13e2d86 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.398846:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=691s v=(0 0) 00010000:00010000:2.0:1790391778.398851:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391778.398856:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f58ee29/0x2b1b7949f13e2d86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.398872:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f58ee29/0x2b1b7949f13e2d86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.398946:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f58ee29/0x2b1b7949f13e2d86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.398955:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f58ee29/0x2b1b7949f13e2d86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.398999:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790391778.400352:0:24815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790391778.400366:0:24815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073163eee/0x2b1b7949f13e2d7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.400391:0:24815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52a7efa600 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:0.0:1790391778.400398:0:24815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073163eee/0x2b1b7949f13e2d7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.400411:0:24815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073163eee/0x2b1b7949f13e2d7f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.400433:0:24815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073163eee/0x2b1b7949f13e2d7f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.400441:0:24815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073163eee/0x2b1b7949f13e2d7f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.400477:0:24815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391778.400485:0:24815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f58ee29/0x2b1b7949f13e2d86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.400492:0:24815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52a7efa800 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:1.0:1790391778.400516:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391778.400518:0:24815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f58ee29/0x2b1b7949f13e2d86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.400532:0:24815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f58ee29/0x2b1b7949f13e2d86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.400544:0:24815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f58ee29/0x2b1b7949f13e2d86 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.400550:0:24815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f58ee29/0x2b1b7949f13e2d86 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.400566:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391778.400570:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391778.400573:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790391778.400726:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790391778.400737:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1ede444/0x2b1b7949f13e2d8d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.400751:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=691s v=(0 0) 00010000:00010000:2.0:1790391778.400756:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391778.400762:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1ede444/0x2b1b7949f13e2d8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.400777:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1ede444/0x2b1b7949f13e2d8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.400787:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1ede444/0x2b1b7949f13e2d8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.401017:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1ede444/0x2b1b7949f13e2d8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.401049:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790391778.401190:0:22764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391778.401198:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1ede444/0x2b1b7949f13e2d8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.401208:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52a7efb200 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:0.0:1790391778.401213:0:22764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1ede444/0x2b1b7949f13e2d8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.401223:0:22764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1ede444/0x2b1b7949f13e2d8d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.401237:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1ede444/0x2b1b7949f13e2d8d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.401253:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1ede444/0x2b1b7949f13e2d8d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.401272:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391778.401274:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391778.401276:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790391778.403499:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790391778.403518:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5414413/0x2b1b7949f13e2d94 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.403539:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=691s v=(0 0) 00010000:00010000:2.0:1790391778.403554:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391778.403563:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5414413/0x2b1b7949f13e2d94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.403582:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5414413/0x2b1b7949f13e2d94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.403595:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5414413/0x2b1b7949f13e2d94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.403604:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5414413/0x2b1b7949f13e2d94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.403637:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790391778.404313:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790391778.404323:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2791965/0x2b1b7949f13e2d9b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.404335:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=691s v=(0 0) 00010000:00010000:2.0:1790391778.404339:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391778.404343:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2791965/0x2b1b7949f13e2d9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.404356:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2791965/0x2b1b7949f13e2d9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.404365:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2791965/0x2b1b7949f13e2d9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.404387:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2791965/0x2b1b7949f13e2d9b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.404408:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790391778.404509:0:24815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790391778.404523:0:24815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5414413/0x2b1b7949f13e2d94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.404537:0:24815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52a7efac00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:0.0:1790391778.404543:0:24815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5414413/0x2b1b7949f13e2d94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.404554:0:24815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5414413/0x2b1b7949f13e2d94 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.404573:0:24815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5414413/0x2b1b7949f13e2d94 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.404581:0:24815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5414413/0x2b1b7949f13e2d94 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.404603:0:24815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391778.404606:0:24815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2791965/0x2b1b7949f13e2d9b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.404620:0:24815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52a7efb000 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:0.0:1790391778.404623:0:24815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2791965/0x2b1b7949f13e2d9b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.404631:0:24815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2791965/0x2b1b7949f13e2d9b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.404640:0:24815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2791965/0x2b1b7949f13e2d9b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.404647:0:24815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2791965/0x2b1b7949f13e2d9b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.404667:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391778.404669:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391778.404671:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790391778.404817:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790391778.404824:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c1aff1d/0x2b1b7949f13e2da2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.404834:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=691s v=(0 0) 00010000:00010000:2.0:1790391778.404837:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391778.404841:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c1aff1d/0x2b1b7949f13e2da2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.404851:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c1aff1d/0x2b1b7949f13e2da2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.404859:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c1aff1d/0x2b1b7949f13e2da2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.404867:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c1aff1d/0x2b1b7949f13e2da2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.404918:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790391778.404928:0:22764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391778.404936:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c1aff1d/0x2b1b7949f13e2da2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.404946:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52a7efbc00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:0.0:1790391778.404950:0:22764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c1aff1d/0x2b1b7949f13e2da2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.404959:0:22764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c1aff1d/0x2b1b7949f13e2da2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.404984:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c1aff1d/0x2b1b7949f13e2da2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.404993:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c1aff1d/0x2b1b7949f13e2da2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.405207:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790391778.405555:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790391778.405563:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001df7415a/0x2b1b7949f13e2da9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.405575:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=691s v=(0 0) 00010000:00010000:1.0:1790391778.405579:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391778.405583:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001df7415a/0x2b1b7949f13e2da9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.405596:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001df7415a/0x2b1b7949f13e2da9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.405614:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001df7415a/0x2b1b7949f13e2da9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.405622:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001df7415a/0x2b1b7949f13e2da9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.405646:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790391778.405833:0:22764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391778.405840:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001df7415a/0x2b1b7949f13e2da9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.405850:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5184055a00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:0.0:1790391778.405854:0:22764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001df7415a/0x2b1b7949f13e2da9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.405864:0:22764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001df7415a/0x2b1b7949f13e2da9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.405898:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001df7415a/0x2b1b7949f13e2da9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.405906:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001df7415a/0x2b1b7949f13e2da9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.405925:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391778.405927:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391778.405937:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790391778.406266:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790391778.406275:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008acea1f3/0x2b1b7949f13e2db0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.406285:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=691s v=(0 0) 00010000:00010000:1.0:1790391778.406289:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391778.406293:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008acea1f3/0x2b1b7949f13e2db0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.406304:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008acea1f3/0x2b1b7949f13e2db0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.406313:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008acea1f3/0x2b1b7949f13e2db0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.406320:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008acea1f3/0x2b1b7949f13e2db0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.406348:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790391778.406359:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391778.406363:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008acea1f3/0x2b1b7949f13e2db0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.406370:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5184054c00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:1.0:1790391778.406375:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008acea1f3/0x2b1b7949f13e2db0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.406391:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008acea1f3/0x2b1b7949f13e2db0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.406406:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008acea1f3/0x2b1b7949f13e2db0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.406413:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008acea1f3/0x2b1b7949f13e2db0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.406429:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391778.406431:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391778.406433:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391778.406594:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790391778.409932:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790391778.409970:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c837415/0x2b1b7949f13e2db7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.409995:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=691s v=(0 0) 00010000:00010000:2.0:1790391778.410001:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391778.410010:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c837415/0x2b1b7949f13e2db7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.410031:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c837415/0x2b1b7949f13e2db7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.410044:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c837415/0x2b1b7949f13e2db7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.410052:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c837415/0x2b1b7949f13e2db7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.410083:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790391778.410594:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790391778.410604:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002aacf68d/0x2b1b7949f13e2dbe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.410615:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=691s v=(0 0) 00010000:00010000:2.0:1790391778.410618:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391778.410623:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002aacf68d/0x2b1b7949f13e2dbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.410636:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002aacf68d/0x2b1b7949f13e2dbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.410653:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002aacf68d/0x2b1b7949f13e2dbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.410661:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002aacf68d/0x2b1b7949f13e2dbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.410687:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790391778.410772:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790391778.410790:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c837415/0x2b1b7949f13e2db7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.410818:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52a7efae00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:0.0:1790391778.410824:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c837415/0x2b1b7949f13e2db7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.410837:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c837415/0x2b1b7949f13e2db7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.410863:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c837415/0x2b1b7949f13e2db7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.410871:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c837415/0x2b1b7949f13e2db7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.410955:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391778.410960:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002aacf68d/0x2b1b7949f13e2dbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.410967:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52a7efa200 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:0.0:1790391778.410971:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002aacf68d/0x2b1b7949f13e2dbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.411137:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790391778.411496:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790391778.411504:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062f92141/0x2b1b7949f13e2dc5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.411515:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=691s v=(0 0) 00010000:00010000:2.0:1790391778.411519:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391778.411524:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062f92141/0x2b1b7949f13e2dc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.411537:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062f92141/0x2b1b7949f13e2dc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.411546:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062f92141/0x2b1b7949f13e2dc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.411553:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062f92141/0x2b1b7949f13e2dc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.411588:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790391778.412033:0:24815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391778.412042:0:24815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062f92141/0x2b1b7949f13e2dc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.412064:0:24815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52a7efa400 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:1.0:1790391778.412069:0:24815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062f92141/0x2b1b7949f13e2dc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.412080:0:24815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062f92141/0x2b1b7949f13e2dc5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.412099:0:24815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062f92141/0x2b1b7949f13e2dc5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.412108:0:24815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062f92141/0x2b1b7949f13e2dc5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.412132:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391778.412134:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391778.412136:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790391778.412660:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790391778.412669:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2327b95/0x2b1b7949f13e2dcc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.412681:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=691s v=(0 0) 00010000:00010000:2.0:1790391778.412685:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391778.412690:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2327b95/0x2b1b7949f13e2dcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.412702:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2327b95/0x2b1b7949f13e2dcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.412710:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2327b95/0x2b1b7949f13e2dcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.412718:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2327b95/0x2b1b7949f13e2dcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.412738:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790391778.413235:0:22764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391778.413244:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2327b95/0x2b1b7949f13e2dcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.413254:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52a7efa000 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:1.0:1790391778.413258:0:22764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2327b95/0x2b1b7949f13e2dcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.413270:0:22764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2327b95/0x2b1b7949f13e2dcc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.413293:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2327b95/0x2b1b7949f13e2dcc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.413302:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2327b95/0x2b1b7949f13e2dcc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.413323:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391778.413325:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391778.413327:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790391778.414163:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790391778.414174:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000462985a/0x2b1b7949f13e2dd3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.414188:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=691s v=(0 0) 00010000:00010000:2.0:1790391778.414201:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391778.414208:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000462985a/0x2b1b7949f13e2dd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.414223:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000462985a/0x2b1b7949f13e2dd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.414233:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000462985a/0x2b1b7949f13e2dd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.414241:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000462985a/0x2b1b7949f13e2dd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.414271:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790391778.414533:0:24815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391778.414552:0:24815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000462985a/0x2b1b7949f13e2dd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.414569:0:24815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52a7efba00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:3.0:1790391778.414576:0:24815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000462985a/0x2b1b7949f13e2dd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.414589:0:24815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000462985a/0x2b1b7949f13e2dd3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.414617:0:24815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000462985a/0x2b1b7949f13e2dd3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.414638:0:24815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000462985a/0x2b1b7949f13e2dd3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.414667:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391778.414669:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391778.414672:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790391778.415578:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790391778.415592:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f3d62dc/0x2b1b7949f13e2dda lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.415607:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=691s v=(0 0) 00010000:00010000:2.0:1790391778.415613:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391778.415619:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f3d62dc/0x2b1b7949f13e2dda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.415633:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f3d62dc/0x2b1b7949f13e2dda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.415642:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f3d62dc/0x2b1b7949f13e2dda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.415658:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f3d62dc/0x2b1b7949f13e2dda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.415681:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790391778.416824:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002aacf68d/0x2b1b7949f13e2dbe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.416895:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002aacf68d/0x2b1b7949f13e2dbe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.416905:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002aacf68d/0x2b1b7949f13e2dbe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.416935:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391778.416941:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f3d62dc/0x2b1b7949f13e2dda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.416949:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52a7efb400 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:0.0:1790391778.416953:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f3d62dc/0x2b1b7949f13e2dda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.416963:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f3d62dc/0x2b1b7949f13e2dda lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.416973:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f3d62dc/0x2b1b7949f13e2dda lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.416982:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f3d62dc/0x2b1b7949f13e2dda lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.416998:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391778.417000:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391778.417008:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790391778.417256:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790391778.417269:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005aeea644/0x2b1b7949f13e2de1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.417285:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=691s v=(0 0) 00010000:00010000:2.0:1790391778.417290:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391778.417297:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005aeea644/0x2b1b7949f13e2de1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.417311:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005aeea644/0x2b1b7949f13e2de1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.417321:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005aeea644/0x2b1b7949f13e2de1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.417328:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005aeea644/0x2b1b7949f13e2de1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.417358:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790391778.417373:0:24815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391778.417773:0:24815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005aeea644/0x2b1b7949f13e2de1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.417785:0:24815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52a7efb600 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:3.0:1790391778.417789:0:24815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005aeea644/0x2b1b7949f13e2de1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.417799:0:24815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005aeea644/0x2b1b7949f13e2de1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.417822:0:24815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005aeea644/0x2b1b7949f13e2de1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.417828:0:24815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005aeea644/0x2b1b7949f13e2de1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.417857:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391778.417862:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391778.417865:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391778.420658:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790391778.426229:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790391778.426253:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9fec1a3/0x2b1b7949f13e2de8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.426286:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=691s v=(0 0) 00010000:00010000:2.0:1790391778.426292:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391778.426300:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9fec1a3/0x2b1b7949f13e2de8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.426320:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9fec1a3/0x2b1b7949f13e2de8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.426332:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9fec1a3/0x2b1b7949f13e2de8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.426341:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9fec1a3/0x2b1b7949f13e2de8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391778.426365:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790391778.434009:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391778.434029:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9fec1a3/0x2b1b7949f13e2de8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.434046:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52a7efaa00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:1.0:1790391778.434052:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9fec1a3/0x2b1b7949f13e2de8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.434066:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9fec1a3/0x2b1b7949f13e2de8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.434095:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9fec1a3/0x2b1b7949f13e2de8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.434104:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9fec1a3/0x2b1b7949f13e2de8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.434164:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391778.434167:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391778.434170:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790391778.439575:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391778.439592:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009550a154/0x2b1b7949f13e2def lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.439612:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=691s v=(0 0) 00010000:00010000:0.0:1790391778.439618:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391778.439625:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009550a154/0x2b1b7949f13e2def lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.439641:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009550a154/0x2b1b7949f13e2def lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.439653:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009550a154/0x2b1b7949f13e2def lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.439663:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009550a154/0x2b1b7949f13e2def lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.440852:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790391778.442644:0:24815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391778.442658:0:24815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009550a154/0x2b1b7949f13e2def lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.442673:0:24815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280031e00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:3.0:1790391778.442679:0:24815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009550a154/0x2b1b7949f13e2def lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.442691:0:24815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009550a154/0x2b1b7949f13e2def lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.442712:0:24815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009550a154/0x2b1b7949f13e2def lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.442720:0:24815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009550a154/0x2b1b7949f13e2def lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.442751:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391778.442753:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391778.442757:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790391778.443840:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391778.443851:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002536b386/0x2b1b7949f13e2df6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.443866:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=691s v=(0 0) 00010000:00010000:0.0:1790391778.443871:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391778.444402:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002536b386/0x2b1b7949f13e2df6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.444435:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002536b386/0x2b1b7949f13e2df6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.444446:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002536b386/0x2b1b7949f13e2df6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.444453:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002536b386/0x2b1b7949f13e2df6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.444471:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790391778.444603:0:22764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391778.444617:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002536b386/0x2b1b7949f13e2df6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.444631:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280030200 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:1.0:1790391778.444638:0:22764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002536b386/0x2b1b7949f13e2df6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.444651:0:22764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002536b386/0x2b1b7949f13e2df6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.444676:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002536b386/0x2b1b7949f13e2df6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.444685:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002536b386/0x2b1b7949f13e2df6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.444716:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391778.444718:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391778.444721:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790391778.445687:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391778.445697:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000482d6837/0x2b1b7949f13e2dfd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.445711:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=691s v=(0 0) 00010000:00010000:0.0:1790391778.445716:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391778.445721:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000482d6837/0x2b1b7949f13e2dfd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.445735:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000482d6837/0x2b1b7949f13e2dfd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.445745:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000482d6837/0x2b1b7949f13e2dfd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.445765:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000482d6837/0x2b1b7949f13e2dfd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.445783:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790391778.446230:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391778.446243:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000482d6837/0x2b1b7949f13e2dfd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.446270:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280030600 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:1.0:1790391778.446277:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000482d6837/0x2b1b7949f13e2dfd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.446289:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000482d6837/0x2b1b7949f13e2dfd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.446314:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000482d6837/0x2b1b7949f13e2dfd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.446325:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000482d6837/0x2b1b7949f13e2dfd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.446365:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391778.446370:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391778.446375:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1790391778.446448:0:25101:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:3.0:1790391778.446486:0:25101:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1790391778.446494:0:25101:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:0.0:1790391778.446657:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391778.446664:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2f5bb09/0x2b1b7949f13e2e04 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.446676:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=691s v=(0 0) 00010000:00010000:0.0:1790391778.446680:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391778.446686:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2f5bb09/0x2b1b7949f13e2e04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.446699:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2f5bb09/0x2b1b7949f13e2e04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.446707:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2f5bb09/0x2b1b7949f13e2e04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.446715:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2f5bb09/0x2b1b7949f13e2e04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391778.446734:0:24284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:23521:x1877361186578048:12345-0@lo:5:osp-pre-1-1.0 Request processed in 89774us (90086us total) trans 12884901889 rc 0/0 00010000:00010000:0.0:1790391778.446738:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790391778.446752:0:24284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1790391778.447474:0:24815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391778.447483:0:24815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2f5bb09/0x2b1b7949f13e2e04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.447495:0:24815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280030400 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:3.0:1790391778.447504:0:24815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2f5bb09/0x2b1b7949f13e2e04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.447514:0:24815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2f5bb09/0x2b1b7949f13e2e04 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.447532:0:24815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2f5bb09/0x2b1b7949f13e2e04 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.447538:0:24815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2f5bb09/0x2b1b7949f13e2e04 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.447556:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391778.447557:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391778.447558:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790391778.447786:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391778.447792:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b769297/0x2b1b7949f13e2e0b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.447817:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=691s v=(0 0) 00010000:00010000:0.0:1790391778.447821:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391778.447828:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b769297/0x2b1b7949f13e2e0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.447843:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b769297/0x2b1b7949f13e2e0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.447853:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b769297/0x2b1b7949f13e2e0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.447860:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b769297/0x2b1b7949f13e2e0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.447908:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790391778.448497:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391778.448504:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b83df72c/0x2b1b7949f13e2e12 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.448514:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=691s v=(0 0) 00010000:00010000:0.0:1790391778.448517:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391778.448522:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b83df72c/0x2b1b7949f13e2e12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.448531:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b83df72c/0x2b1b7949f13e2e12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.448552:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b83df72c/0x2b1b7949f13e2e12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.448560:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b83df72c/0x2b1b7949f13e2e12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.448579:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1790391778.448855:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391778.448861:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cc1de1d/0x2b1b7949f13e2e19 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.448870:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=691s v=(0 0) 00010000:00010000:0.0:1790391778.448872:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391778.448906:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cc1de1d/0x2b1b7949f13e2e19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.448918:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009cc1de1d/0x2b1b7949f13e2e19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.448926:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cc1de1d/0x2b1b7949f13e2e19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.448934:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009cc1de1d/0x2b1b7949f13e2e19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.448972:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1790391778.449161:0:22764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1790391778.449162:0:24815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790391778.449187:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b769297/0x2b1b7949f13e2e0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.449189:0:24815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b83df72c/0x2b1b7949f13e2e12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.449223:0:24815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280031400 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:3.0:1790391778.449228:0:24815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b83df72c/0x2b1b7949f13e2e12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.449239:0:24815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b83df72c/0x2b1b7949f13e2e12 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.449253:0:24815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b83df72c/0x2b1b7949f13e2e12 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.449267:0:24815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b83df72c/0x2b1b7949f13e2e12 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.449284:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280031a00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:3.0:1790391778.449290:0:24815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391778.449291:0:22764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b769297/0x2b1b7949f13e2e0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.449298:0:24815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009cc1de1d/0x2b1b7949f13e2e19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.449330:0:24815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280031600 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:3.0:1790391778.449337:0:24815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009cc1de1d/0x2b1b7949f13e2e19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.449341:0:22764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b769297/0x2b1b7949f13e2e0b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.449367:0:24815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009cc1de1d/0x2b1b7949f13e2e19 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.449381:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b769297/0x2b1b7949f13e2e0b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.449392:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b769297/0x2b1b7949f13e2e0b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.449420:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391778.449422:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391778.449424:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790391778.449723:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391778.449732:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6dda782/0x2b1b7949f13e2e20 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.449743:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=691s v=(0 0) 00010000:00010000:0.0:1790391778.449747:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391778.449751:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6dda782/0x2b1b7949f13e2e20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.449761:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6dda782/0x2b1b7949f13e2e20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.449769:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6dda782/0x2b1b7949f13e2e20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.449776:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6dda782/0x2b1b7949f13e2e20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.449800:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790391778.449991:0:22764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391778.449998:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6dda782/0x2b1b7949f13e2e20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.450006:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280030000 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:1.0:1790391778.450011:0:22764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6dda782/0x2b1b7949f13e2e20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.450184:0:24815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009cc1de1d/0x2b1b7949f13e2e19 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.450196:0:24815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009cc1de1d/0x2b1b7949f13e2e19 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.450216:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391778.450218:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391778.450220:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790391778.450302:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391778.450308:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fa0e299/0x2b1b7949f13e2e27 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.450317:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=691s v=(0 0) 00010000:00010000:0.0:1790391778.450328:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391778.450334:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005fa0e299/0x2b1b7949f13e2e27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.450345:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005fa0e299/0x2b1b7949f13e2e27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.450355:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fa0e299/0x2b1b7949f13e2e27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.450364:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005fa0e299/0x2b1b7949f13e2e27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.450388:0:22764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6dda782/0x2b1b7949f13e2e20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.450408:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6dda782/0x2b1b7949f13e2e20 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.450428:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6dda782/0x2b1b7949f13e2e20 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.450454:0:22764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391778.450458:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005fa0e299/0x2b1b7949f13e2e27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.450464:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280030e00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:1.0:1790391778.450468:0:22764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005fa0e299/0x2b1b7949f13e2e27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.450473:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1790391778.450480:0:22764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005fa0e299/0x2b1b7949f13e2e27 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.450494:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005fa0e299/0x2b1b7949f13e2e27 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.450504:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005fa0e299/0x2b1b7949f13e2e27 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391778.450526:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391778.450529:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391778.450648:0:23521:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1790391778.450659:0:23521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23521:1877361186578048:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1790391778.450676:0:23521:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:0.0:1790391778.450729:0:23521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23521:1877361186578176:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1790391778.450793:0:23521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391778.450842:0:23521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a097c000 going to sleep for 11 seconds 00010000:00010000:3.0:1790391778.451135:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391778.452291:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391778.452342:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186578176 00000100:00100000:0.0:1790391778.452356:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186578176 00000100:00100000:0.0:1790391778.452429:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790391778.452443:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23521:x1877361186578176:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1790391778.452569:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23521:x1877361186578176:12345-0@lo:900:osp-pre-1-1.0 Request processed in 129us (1775us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391778.452586:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00002000:00010000:0.0:1790391778.452719:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391778.452729:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013a64525/0x2b1b7949f13e2e2e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.452748:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=691s v=(0 0) 00010000:00010000:0.0:1790391778.452754:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391778.452761:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013a64525/0x2b1b7949f13e2e2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.452777:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013a64525/0x2b1b7949f13e2e2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.452788:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013a64525/0x2b1b7949f13e2e2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.452796:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000013a64525/0x2b1b7949f13e2e2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391778.452823:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790391778.452935:0:24815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391778.453176:0:24815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013a64525/0x2b1b7949f13e2e2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.453207:0:24815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295144600 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:3.0:1790391778.453211:0:24815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013a64525/0x2b1b7949f13e2e2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.453224:0:24815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013a64525/0x2b1b7949f13e2e2e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.453248:0:24815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013a64525/0x2b1b7949f13e2e2e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.453256:0:24815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013a64525/0x2b1b7949f13e2e2e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391778.453287:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391778.453289:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391778.453291:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1790391778.456409:0:24766:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:0.0:1790391778.456556:0:24766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22803:x1877361186577536:12345-0@lo:5:osp-pre-1-0.0 Request processed in 131900us (132518us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391778.456568:0:24766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1790391778.456677:0:23521:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183b7ed80 x1877361186578176/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790391794 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391778.456712:0:23521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23521:1877361186578176:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1790391778.457379:0:22803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cba680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22803:1877361186577536:0@lo:5:osp-pre-1-0.0 00010000:00010000:1.0:1790391778.457736:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1790391778.458383:0:22803:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:3.0:1790391778.458437:0:22803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cba680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22803:1877361186578304:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1790391778.458501:0:22803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391778.458534:0:22803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528776ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1790391778.459704:0:24286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186578304 00000100:00100000:2.0:1790391778.459720:0:24286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186578304 00000100:00100000:2.0:1790391778.459820:0:24286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790391778.459833:0:24286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22803:x1877361186578304:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1790391778.459916:0:24286:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:3.0:1790391778.468228:0:24286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22803:x1877361186578304:12345-0@lo:5:osp-pre-1-0.0 Request processed in 8389us (9718us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1790391778.468241:0:24286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790391778.468466:0:22803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cba680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22803:1877361186578304:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1790391778.468488:0:22803:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:1.0:1790391779.144158:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391780.168217:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790391780.543970:0:25457:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg228-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790391781.193451:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1790391781.441527:0:25509:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790391781.441767:0:25509:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1790391781.896691:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186578432:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790391781.896984:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391781.897287:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186578432 00000100:00100000:3.0:1790391781.897299:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186578432 00000100:00100000:3.0:1790391781.897385:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790391781.897395:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf94b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186578432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790391781.897444:0:22782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1790391781.897515:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf94b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186578432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391781.897522:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790391781.897556:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186578432:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790391781.899552:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186578560:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790391781.899654:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391781.899947:0:24288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186578560 00000100:00100000:2.0:1790391781.899960:0:24288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186578560 00000100:00080000:1.0:1790391781.900058:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790391781.900061:0:24288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790391781.900072:0:24288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518331f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186578560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790391781.900110:0:24288:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1790391781.900180:0:24288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518331f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186578560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391781.900188:0:24288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790391781.900267:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186578560:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1790391782.216336:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391782.408503:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790391782.408542:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186578688:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790391782.408644:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391782.408710:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186578688 00000100:00100000:2.0:1790391782.408723:0:22781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186578688 00000100:00100000:2.0:1790391782.412714:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790391782.412738:0:22781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186578688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790391782.412792:0:22781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790391782.412896:0:22781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186578688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 168us (4252us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391782.412904:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790391782.413097:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186578688:0@lo:41:osp-pre-1-0.0 00000020:00000004:1.0:1790391782.705217:0:25559:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790391782.705723:0:25559:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1790391782.921707:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186578816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790391782.921793:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391782.929780:0:24288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186578816 00000100:00100000:0.0:1790391782.929796:0:24288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186578816 00000100:00100000:0.0:1790391782.929894:0:24288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790391782.929905:0:24288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186578816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790391782.929929:0:24288:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1790391782.930066:0:24288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186578816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 163us (8272us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391782.930073:0:24288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1790391782.930095:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790391782.930142:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186578816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790391783.083554:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391783.083667:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169678720 00000100:00100000:3.0:1790391783.083679:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169678720 00000100:00100000:3.0:1790391783.083734:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 116 00000100:00100000:3.0:1790391783.083742:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2380:x1877361169678720:12345-192.168.202.28@tcp:250:mount.lustre.0 00010000:00080000:3.0:1790391783.083782:0:22770:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 87c34307-e556-4f71-950f-f0a41a7cdef6@192.168.202.28@tcp t0 exp 0000000000000000 cur 696 last 0 00000020:00000080:3.0:1790391783.083814:0:22770:0:(genops.c:1385:class_connect()) connect: client 87c34307-e556-4f71-950f-f0a41a7cdef6, cookie 0x2b1b7949f13e2e35 00000100:00080000:3.0:1790391783.084001:0:22770:0:(import.c:65:import_set_state_nolock()) ffff9e5182c67800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790391783.084397:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87c34307-e556-4f71-950f-f0a41a7cdef6+5:2380:x1877361169678720:12345-192.168.202.28@tcp:250:mount.lustre.0 Request processed in 652us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391783.084407:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 116 00000100:00100000:3.0:1790391783.099683:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391783.099803:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169678848 00000100:00100000:1.0:1790391783.099814:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169678848 00000100:00100000:1.0:1790391783.099910:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 117 00000100:00100000:1.0:1790391783.099922:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7674850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87c34307-e556-4f71-950f-f0a41a7cdef6+5:18076:x1877361169678848:12345-192.168.202.28@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790391783.099940:0:22769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391783.099960:0:22769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5184054c00/0x2b1b7949f13e2e3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b06a2 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391783.099992:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5184054c00/0x2b1b7949f13e2e3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b06a2 expref: 6 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391783.100004:0:22769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5184054c00/0x2b1b7949f13e2e3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b06a2 expref: 6 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391783.100014:0:22769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5184054c00, rc 0) 00000100:00100000:1.0:1790391783.100082:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7674850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87c34307-e556-4f71-950f-f0a41a7cdef6+6:18076:x1877361169678848:12345-192.168.202.28@tcp:101:mount.lustre.0 Request processed in 162us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391783.100090:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 117 00000100:00100000:0.0:1790391783.105781:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391783.105873:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169678976 00000100:00100000:3.0:1790391783.105905:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169678976 00000100:00100000:3.0:1790391783.105959:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 118 00000100:00100000:3.0:1790391783.105970:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87c34307-e556-4f71-950f-f0a41a7cdef6+6:18076:x1877361169678976:12345-192.168.202.28@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790391783.106117:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87c34307-e556-4f71-950f-f0a41a7cdef6+6:18076:x1877361169678976:12345-192.168.202.28@tcp:501:mount.lustre.0 Request processed in 149us (344us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790391783.106139:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 118 00000100:00100000:2.0:1790391783.107683:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391783.107766:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169679104 00000100:00100000:0.0:1790391783.107774:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169679104 00000100:00100000:0.0:1790391783.107811:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 119 00000100:00100000:0.0:1790391783.107819:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87c34307-e556-4f71-950f-f0a41a7cdef6+6:18076:x1877361169679104:12345-192.168.202.28@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790391783.107838:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391783.107854:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5295145200/0x2b1b7949f13e2e43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b06a9 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391783.107904:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5295145200/0x2b1b7949f13e2e43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b06a9 expref: 7 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391783.107916:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5295145200/0x2b1b7949f13e2e43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b06a9 expref: 7 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391783.107926:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5295145200, rc 0) 00000100:00100000:0.0:1790391783.107964:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87c34307-e556-4f71-950f-f0a41a7cdef6+7:18076:x1877361169679104:12345-192.168.202.28@tcp:101:mount.lustre.0 Request processed in 146us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391783.107971:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 119 00000040:00080000:1.0:1790391783.112595:0:23532:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790391783.114776:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391783.115169:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169679232 00000100:00100000:1.0:1790391783.115180:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169679232 00000100:00100000:1.0:1790391783.115248:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 120 00000100:00100000:1.0:1790391783.115258:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87c34307-e556-4f71-950f-f0a41a7cdef6+7:18076:x1877361169679232:12345-192.168.202.28@tcp:501:mount.lustre.0 00000100:00100000:1.0:1790391783.115541:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87c34307-e556-4f71-950f-f0a41a7cdef6+8:18076:x1877361169679232:12345-192.168.202.28@tcp:501:mount.lustre.0 Request processed in 284us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391783.115550:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 120 00000100:00100000:2.0:1790391783.125459:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391783.125582:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169679360 00000100:00100000:3.0:1790391783.125591:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169679360 00000100:00100000:3.0:1790391783.125645:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 121 00000100:00100000:3.0:1790391783.125654:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7676450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87c34307-e556-4f71-950f-f0a41a7cdef6+8:18076:x1877361169679360:12345-192.168.202.28@tcp:503:mount.lustre.0 00000100:00100000:3.0:1790391783.125807:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7676450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87c34307-e556-4f71-950f-f0a41a7cdef6+8:18076:x1877361169679360:12345-192.168.202.28@tcp:503:mount.lustre.0 Request processed in 154us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391783.125815:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 121 00000100:00100000:2.0:1790391783.137550:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391783.137639:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169679488 00000100:00100000:0.0:1790391783.137649:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169679488 00000100:00100000:0.0:1790391783.137701:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 122 00000100:00100000:0.0:1790391783.137710:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87c34307-e556-4f71-950f-f0a41a7cdef6+8:18095:x1877361169679488:12345-192.168.202.28@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790391783.137913:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87c34307-e556-4f71-950f-f0a41a7cdef6+8:18095:x1877361169679488:12345-192.168.202.28@tcp:502:llog_process_th.0 Request processed in 202us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391783.137921:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 122 00000100:00100000:2.0:1790391783.173175:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391783.173294:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169679616 00000100:00100000:1.0:1790391783.173305:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169679616 00000100:00100000:1.0:1790391783.173373:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 123 00000100:00100000:1.0:1790391783.173385:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87c34307-e556-4f71-950f-f0a41a7cdef6+8:18095:x1877361169679616:12345-192.168.202.28@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790391783.173557:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87c34307-e556-4f71-950f-f0a41a7cdef6+8:18095:x1877361169679616:12345-192.168.202.28@tcp:502:llog_process_th.0 Request processed in 174us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391783.173565:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 123 00000100:00100000:2.0:1790391783.186377:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391783.186590:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169679744 00000100:00100000:3.0:1790391783.186599:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169679744 00000100:00100000:3.0:1790391783.186656:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 124 00000100:00100000:3.0:1790391783.186666:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87c34307-e556-4f71-950f-f0a41a7cdef6+8:18095:x1877361169679744:12345-192.168.202.28@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790391783.186829:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87c34307-e556-4f71-950f-f0a41a7cdef6+8:18095:x1877361169679744:12345-192.168.202.28@tcp:502:llog_process_th.0 Request processed in 164us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391783.186837:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 124 00000100:00100000:2.0:1790391783.190984:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391783.191073:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169679872 00000100:00100000:0.0:1790391783.191083:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169679872 00000100:00100000:0.0:1790391783.191144:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 125 00000100:00100000:0.0:1790391783.191155:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87c34307-e556-4f71-950f-f0a41a7cdef6+8:18076:x1877361169679872:12345-192.168.202.28@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790391783.191172:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391783.191205:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5295144200/0x2b1b7949f13e2e4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b06da expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391783.191246:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5295144200/0x2b1b7949f13e2e4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b06da expref: 9 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391783.191259:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5295144200/0x2b1b7949f13e2e4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b06da expref: 9 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391783.191268:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5295144200, rc 0) 00000100:00100000:0.0:1790391783.191347:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87c34307-e556-4f71-950f-f0a41a7cdef6+9:18076:x1877361169679872:12345-192.168.202.28@tcp:101:mount.lustre.0 Request processed in 187us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391783.191354:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 125 00000100:00100000:2.0:1790391783.194179:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391783.194270:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169680000 00000100:00100000:1.0:1790391783.194281:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169680000 00000100:00100000:1.0:1790391783.194346:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 126 00000100:00100000:1.0:1790391783.194355:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87c34307-e556-4f71-950f-f0a41a7cdef6+9:18076:x1877361169680000:12345-192.168.202.28@tcp:256:mount.lustre.0 20000000:01000000:1.0:1790391783.194378:0:22769:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1790391783.194399:0:22769:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1790391783.194403:0:22769:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1790391783.194406:0:22769:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1790391783.194410:0:22769:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1790391783.194412:0:22769:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1790391783.197107:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87c34307-e556-4f71-950f-f0a41a7cdef6+9:18076:x1877361169680000:12345-192.168.202.28@tcp:256:mount.lustre.0 Request processed in 2742us (2926us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391783.197134:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 126 00000100:00100000:2.0:1790391783.208566:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391783.209820:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169680128 00000100:00100000:3.0:1790391783.209834:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169680128 00000100:00100000:3.0:1790391783.209941:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 127 00000100:00100000:3.0:1790391783.209952:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87c34307-e556-4f71-950f-f0a41a7cdef6+9:18076:x1877361169680128:12345-192.168.202.28@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790391783.209969:0:22770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391783.209987:0:22770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52bab9d600/0x2b1b7949f13e2e51 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b06e1 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391783.210016:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52bab9d600/0x2b1b7949f13e2e51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b06e1 expref: 10 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391783.210047:0:22770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52bab9d600/0x2b1b7949f13e2e51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b06e1 expref: 10 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391783.210057:0:22770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52bab9d600, rc 0) 00000100:00100000:3.0:1790391783.210127:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87c34307-e556-4f71-950f-f0a41a7cdef6+10:18076:x1877361169680128:12345-192.168.202.28@tcp:101:mount.lustre.0 Request processed in 177us (1572us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391783.210135:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 127 00000100:00100000:2.0:1790391783.213178:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391783.213275:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169680256 00000100:00100000:1.0:1790391783.213285:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169680256 00000100:00100000:1.0:1790391783.213356:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 128 00000100:00100000:1.0:1790391783.213366:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b778f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87c34307-e556-4f71-950f-f0a41a7cdef6+10:18076:x1877361169680256:12345-192.168.202.28@tcp:501:mount.lustre.0 00000100:00100000:1.0:1790391783.213510:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b778f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87c34307-e556-4f71-950f-f0a41a7cdef6+10:18076:x1877361169680256:12345-192.168.202.28@tcp:501:mount.lustre.0 Request processed in 145us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391783.213518:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 128 00000100:00100000:2.0:1790391783.216794:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391783.216930:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169680384 00000100:00100000:0.0:1790391783.216940:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169680384 00000100:00100000:0.0:1790391783.216989:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 129 00000100:00100000:0.0:1790391783.216998:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b778f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87c34307-e556-4f71-950f-f0a41a7cdef6+10:18076:x1877361169680384:12345-192.168.202.28@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790391783.217142:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b778f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87c34307-e556-4f71-950f-f0a41a7cdef6+10:18076:x1877361169680384:12345-192.168.202.28@tcp:503:mount.lustre.0 Request processed in 143us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391783.217149:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 129 00000100:00100000:2.0:1790391783.221352:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391783.221441:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169680512 00000100:00100000:3.0:1790391783.221451:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169680512 00000100:00100000:3.0:1790391783.221511:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 130 00000100:00100000:3.0:1790391783.221521:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b778d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87c34307-e556-4f71-950f-f0a41a7cdef6+10:18100:x1877361169680512:12345-192.168.202.28@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790391783.221676:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b778d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87c34307-e556-4f71-950f-f0a41a7cdef6+10:18100:x1877361169680512:12345-192.168.202.28@tcp:502:llog_process_th.0 Request processed in 156us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391783.221685:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 130 00000100:00100000:3.0:1790391783.230688:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391783.230806:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169680640 00000100:00100000:2.0:1790391783.230830:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169680640 00000100:00100000:2.0:1790391783.230911:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 131 00000100:00100000:2.0:1790391783.230922:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b778c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87c34307-e556-4f71-950f-f0a41a7cdef6+10:18100:x1877361169680640:12345-192.168.202.28@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790391783.231078:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b778c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87c34307-e556-4f71-950f-f0a41a7cdef6+10:18100:x1877361169680640:12345-192.168.202.28@tcp:502:llog_process_th.0 Request processed in 157us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391783.231087:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 131 00010000:00010000:1.0:1790391783.240583:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391783.247081:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391783.247206:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391783.247973:0:23840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169680768 00000100:00100000:0.0:1790391783.247986:0:23840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169680768 00000100:00100000:0.0:1790391783.248073:0:23840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169681024 00000100:00100000:0.0:1790391783.248077:0:23840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169681024 00000100:00100000:3.0:1790391783.250120:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 7 00000100:00100000:3.0:1790391783.250133:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2380:x1877361169680768:12345-192.168.202.28@tcp:38:mount.lustre.0 00010000:00080000:3.0:1790391783.250177:0:22777:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from c67287cd-8d89-444e-807d-10aa5015d6e5@192.168.202.28@tcp t0 exp 0000000000000000 cur 696 last 0 00000020:00000080:3.0:1790391783.251153:0:22777:0:(genops.c:1385:class_connect()) connect: client c67287cd-8d89-444e-807d-10aa5015d6e5, cookie 0x2b1b7949f13e2e58 00000004:00100000:3.0:1790391783.251183:0:22777:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1790391783.251582:0:22777:0:(import.c:65:import_set_state_nolock()) ffff9e5182c65800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790391783.251658:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+6:2380:x1877361169680768:12345-192.168.202.28@tcp:38:mount.lustre.0 Request processed in 1525us (4587us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391783.251668:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 7 00000100:00100000:3.0:1790391783.251707:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 8 00000100:00100000:3.0:1790391783.251714:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf94aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2380:x1877361169681024:12345-192.168.202.28@tcp:38:mount.lustre.0 00010000:00080000:3.0:1790391783.251899:0:22777:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from c67287cd-8d89-444e-807d-10aa5015d6e5@192.168.202.28@tcp t0 exp 0000000000000000 cur 696 last 0 00000020:00000080:3.0:1790391783.251938:0:22777:0:(genops.c:1385:class_connect()) connect: client c67287cd-8d89-444e-807d-10aa5015d6e5, cookie 0x2b1b7949f13e2e5f 00000004:00100000:3.0:1790391783.251955:0:22777:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1790391783.252135:0:22777:0:(import.c:65:import_set_state_nolock()) ffff9e5182c63800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790391783.252162:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf94aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+6:2380:x1877361169681024:12345-192.168.202.28@tcp:38:mount.lustre.0 Request processed in 447us (4956us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391783.252168:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 8 00000100:00100000:0.0:1790391783.261024:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391783.261066:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391783.261161:0:23840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169680896 00000100:00100000:1.0:1790391783.261172:0:23840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169680896 00000100:00100000:1.0:1790391783.261247:0:23840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169681152 00000100:00100000:1.0:1790391783.261250:0:23840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169681152 00000100:00100000:1.0:1790391783.261276:0:23840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 9 00000100:00100000:1.0:1790391783.261285:0:23840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c67287cd-8d89-444e-807d-10aa5015d6e5+6:0:x1877361169680896:12345-192.168.202.28@tcp:41:mount.lustre.0 00000004:00000024:1.0:1790391783.261330:0:23840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1790391783.261425:0:23840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c67287cd-8d89-444e-807d-10aa5015d6e5+6:0:x1877361169680896:12345-192.168.202.28@tcp:41:mount.lustre.0 Request processed in 141us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391783.261433:0:23840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 9 00000100:00100000:1.0:1790391783.261450:0:23840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 10 00000100:00100000:1.0:1790391783.261456:0:23840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c67287cd-8d89-444e-807d-10aa5015d6e5+6:0:x1877361169681152:12345-192.168.202.28@tcp:41:mount.lustre.0 00000004:00000024:1.0:1790391783.261473:0:23840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790391783.261509:0:23840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c67287cd-8d89-444e-807d-10aa5015d6e5+6:0:x1877361169681152:12345-192.168.202.28@tcp:41:mount.lustre.0 Request processed in 53us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391783.261515:0:23840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 10 00000100:00080000:0.0:1790391783.262112:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790391783.262117:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790391783.267693:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391783.267811:0:23840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169681280 00000100:00100000:1.0:1790391783.267822:0:23840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169681280 00000100:00100000:1.0:1790391783.267919:0:23840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 11 00000100:00100000:1.0:1790391783.267929:0:23840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c67287cd-8d89-444e-807d-10aa5015d6e5+6:18076:x1877361169681280:12345-192.168.202.28@tcp:41:mount.lustre.0 00000004:00000024:1.0:1790391783.267961:0:23840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1790391783.268023:0:23840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c67287cd-8d89-444e-807d-10aa5015d6e5+6:18076:x1877361169681280:12345-192.168.202.28@tcp:41:mount.lustre.0 Request processed in 96us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391783.268030:0:23840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 11 00000100:00100000:1.0:1790391783.278248:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391783.281522:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169681408 00000100:00100000:2.0:1790391783.281540:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169681408 00000100:00100000:2.0:1790391783.281688:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 12 00000100:00100000:2.0:1790391783.281701:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c67287cd-8d89-444e-807d-10aa5015d6e5+6:18076:x1877361169681408:12345-192.168.202.28@tcp:40:mount.lustre.0 00000100:00100000:2.0:1790391783.281835:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c67287cd-8d89-444e-807d-10aa5015d6e5+6:18076:x1877361169681408:12345-192.168.202.28@tcp:40:mount.lustre.0 Request processed in 136us (3608us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391783.281843:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 12 00000100:00100000:1.0:1790391783.295542:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391783.295580:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391783.295662:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391783.295985:0:24766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169681536 00000100:00100000:3.0:1790391783.295998:0:24766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169681536 00000100:00100000:3.0:1790391783.296041:0:24766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169681664 00000100:00100000:3.0:1790391783.296044:0:24766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169681664 00000100:00100000:3.0:1790391783.296066:0:24766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 19 00000100:00100000:3.0:1790391783.296075:0:24766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2380:x1877361169681536:12345-192.168.202.28@tcp:8:mount.lustre.0 00010000:00080000:3.0:1790391783.296113:0:24766:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c67287cd-8d89-444e-807d-10aa5015d6e5@192.168.202.28@tcp t0 exp 0000000000000000 cur 696 last 0 00000020:00000080:3.0:1790391783.296171:0:24766:0:(genops.c:1385:class_connect()) connect: client c67287cd-8d89-444e-807d-10aa5015d6e5, cookie 0x2b1b7949f13e2e66 00002000:00100000:3.0:1790391783.296184:0:24766:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c67287cd-8d89-444e-807d-10aa5015d6e5/ffff9e528f60a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790391783.296195:0:24766:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790391783.296438:0:24766:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790391783.296470:0:24766:0:(import.c:65:import_set_state_nolock()) ffff9e528f60e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790391783.296542:0:24766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c67287cd-8d89-444e-807d-10aa5015d6e5+6:2380:x1877361169681536:12345-192.168.202.28@tcp:8:mount.lustre.0 Request processed in 466us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391783.296550:0:24766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 19 00000100:00100000:3.0:1790391783.296570:0:24766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 20 00000100:00100000:3.0:1790391783.296583:0:24766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2380:x1877361169681664:12345-192.168.202.28@tcp:8:mount.lustre.0 00010000:00080000:3.0:1790391783.296603:0:24766:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from c67287cd-8d89-444e-807d-10aa5015d6e5@192.168.202.28@tcp t0 exp 0000000000000000 cur 696 last 0 00000020:00000080:3.0:1790391783.296621:0:24766:0:(genops.c:1385:class_connect()) connect: client c67287cd-8d89-444e-807d-10aa5015d6e5, cookie 0x2b1b7949f13e2e6d 00002000:00100000:3.0:1790391783.296627:0:24766:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c67287cd-8d89-444e-807d-10aa5015d6e5/ffff9e528f608000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790391783.296641:0:24766:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790391783.296744:0:24766:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1790391783.296777:0:24766:0:(import.c:65:import_set_state_nolock()) ffff9e528f609000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790391783.296803:0:24766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c67287cd-8d89-444e-807d-10aa5015d6e5+6:2380:x1877361169681664:12345-192.168.202.28@tcp:8:mount.lustre.0 Request processed in 218us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391783.296809:0:24766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 20 00000100:00100000:0.0:1790391783.297025:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169681792 00000100:00100000:0.0:1790391783.297037:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169681792 00000100:00100000:0.0:1790391783.297083:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 3 00000100:00100000:0.0:1790391783.297091:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c67287cd-8d89-444e-807d-10aa5015d6e5+6:18076:x1877361169681792:12345-192.168.202.28@tcp:900:mount.lustre.0 00000100:00100000:0.0:1790391783.297126:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c67287cd-8d89-444e-807d-10aa5015d6e5+6:18076:x1877361169681792:12345-192.168.202.28@tcp:900:mount.lustre.0 Request processed in 37us (1594us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391783.297133:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 3 00000100:00100000:0.0:1790391783.300037:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391783.300171:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169681920 00000100:00100000:2.0:1790391783.300182:0:22779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169681920 00000100:00100000:2.0:1790391783.300533:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 0 00000100:00100000:2.0:1790391783.300546:0:22779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+6:18076:x1877361169681920:12345-192.168.202.28@tcp:33:mount.lustre.0 00000004:00080000:0.0:1790391783.303074:0:22779:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2440us 00000004:00200000:3.0:1790391783.315470:0:22779:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1790391783.315595:0:22779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+6:18076:x1877361169681920:12345-192.168.202.28@tcp:33:mount.lustre.0 Request processed in 15046us (15563us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391783.315608:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 0 00000100:00100000:3.0:1790391783.434141:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186579072:0@lo:400:kworker.0 00000100:00100000:0.0:1790391783.434141:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186579200:0@lo:400:kworker.0 00000100:00100000:2.0:1790391783.434252:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e907dcd1-fffe-43bb-853f-376b925bb229:3640:1877361186578944:0@lo:400:kworker.0 00000100:00100000:1.0:1790391783.434344:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877361186579328:0@lo:400:kworker.0 00000100:00100000:0.0:1790391783.434692:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391783.434731:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186579712:0@lo:400:kworker.0 00000100:00100000:0.0:1790391783.434765:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391783.434784:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1877361186580224:0@lo:400:kworker.0 00000100:00100000:0.0:1790391783.434809:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391783.434933:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790391783.434941:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183ba8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186580608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790391783.434967:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391783.434995:0:24288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186580608 00000100:00100000:0.0:1790391783.435002:0:24288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186580608 00000100:00100000:0.0:1790391783.435053:0:24288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790391783.435062:0:24288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183ba8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1877361186580608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790391783.435083:0:24288:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790391783.435125:0:24288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183ba8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1877361186580608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391783.435132:0:24288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1790391783.435169:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790391783.435205:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183ba8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186580608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790391783.435434:0:23840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186580224 00000100:00100000:0.0:1790391783.435439:0:23840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186580224 00000100:00100000:0.0:1790391783.435474:0:23840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790391783.435481:0:23840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877361186580224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391783.435775:0:23840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877361186580224:12345-0@lo:400:kworker.0 Request processed in 293us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391783.435782:0:23840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1790391783.435799:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790391783.435818:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518331c380 x1877361186580224/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391783.435829:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1877361186580224:0@lo:400:kworker.0 00000100:00100000:3.0:1790391783.442145:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391783.442223:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186579584:0@lo:400:kworker.0 00000100:00100000:3.0:1790391783.442414:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391783.442447:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1877361186580096:0@lo:400:kworker.0 00000100:00100000:3.0:1790391783.443141:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391783.443206:0:24286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186579200 00000100:00100000:3.0:1790391783.443215:0:24286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186579200 00000100:00100000:3.0:1790391783.443408:0:24286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186579712 00000100:00100000:3.0:1790391783.443413:0:24286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186579712 00000100:00100000:3.0:1790391783.443442:0:24286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186579584 00000100:00100000:3.0:1790391783.443458:0:24286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186579584 00000100:00100000:0.0:1790391783.443611:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186579072 00000100:00100000:0.0:1790391783.443616:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186579072 00000100:00100000:3.0:1790391783.443657:0:24286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790391783.443658:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790391783.443666:0:24286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3638:x1877361186579200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391783.443666:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186579072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391783.447469:0:24284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790391783.447493:0:24284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186579712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391783.448445:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186579072:12345-0@lo:400:kworker.0 Request processed in 4774us (6303us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391783.448462:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790391783.449200:0:24286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3638:x1877361186579200:12345-0@lo:400:kworker.0 Request processed in 5532us (14505us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391783.449212:0:24286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790391783.449247:0:24286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790391783.449259:0:24286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186579584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391783.449305:0:24286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186579584:12345-0@lo:400:kworker.0 Request processed in 51us (6891us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391783.449312:0:24286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1790391783.449330:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790391783.449439:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790391783.449459:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186580096 00000100:00100000:3.0:1790391783.449479:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186580096 00000100:00100000:3.0:1790391783.449524:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790391783.449531:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877361186580096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391783.449561:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877361186580096:12345-0@lo:400:kworker.0 Request processed in 31us (6422us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391783.449566:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1790391783.449580:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790391783.449629:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186579072:0@lo:400:kworker.0 00000100:00100000:3.0:1790391783.449643:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186579584:0@lo:400:kworker.0 00010000:00080000:3.0:1790391783.449655:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183b7e680 x1877361186580096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391783.449666:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1877361186580096:0@lo:400:kworker.0 00000100:00100000:3.0:1790391783.449767:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391783.449803:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186579456:0@lo:400:kworker.0 00000100:00100000:3.0:1790391783.449832:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391783.449848:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1877361186579968:0@lo:400:kworker.0 00000100:00100000:3.0:1790391783.449872:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391783.449913:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183ba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186580480:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790391783.449934:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391783.449968:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186579968 00000100:00100000:3.0:1790391783.449972:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186579968 00000100:00100000:3.0:1790391783.450000:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790391783.450006:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877361186579968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391783.450221:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877361186579968:12345-0@lo:400:kworker.0 Request processed in 214us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391783.450228:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1790391783.450313:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790391783.450407:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183b7fb80 x1877361186579968/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391783.450420:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1877361186579968:0@lo:400:kworker.0 00000100:00100000:0.0:1790391783.450608:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186578944 00000100:00100000:0.0:1790391783.450613:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186578944 00000100:00100000:0.0:1790391783.450654:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1790391783.450662:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b778e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+24:3640:x1877361186578944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391783.450707:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b778e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+24:3640:x1877361186578944:12345-0@lo:400:kworker.0 Request processed in 46us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391783.450726:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1790391783.450769:0:24288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186580480 00000100:00100000:0.0:1790391783.450773:0:24288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186580480 00000100:00100000:0.0:1790391783.450797:0:24288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790391783.450804:0:24288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1877361186580480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790391783.450819:0:24288:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790391783.450852:0:24288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1877361186580480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391783.450858:0:24288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790391783.450898:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186579456 00000100:00100000:0.0:1790391783.450902:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186579456 00000100:00100000:0.0:1790391783.450927:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790391783.450933:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186579456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391783.450980:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186579456:12345-0@lo:400:kworker.0 Request processed in 47us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391783.450986:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790391783.451316:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186579200:0@lo:400:kworker.0 00000100:00100000:0.0:1790391783.451423:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183ba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186580480:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790391783.451432:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e907dcd1-fffe-43bb-853f-376b925bb229:3640:1877361186578944:0@lo:400:kworker.0 00000100:00100000:0.0:1790391783.451442:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186579456:0@lo:400:kworker.0 00000100:00100000:2.0:1790391783.459210:0:24284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186579712:12345-0@lo:400:kworker.0 Request processed in 11717us (24443us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391783.459244:0:24284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790391783.459413:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391783.459435:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186579712:0@lo:400:kworker.0 00000100:00100000:1.0:1790391783.459457:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877361186579840:0@lo:400:kworker.0 00000100:00100000:1.0:1790391783.459495:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391783.459532:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1877361186580352:0@lo:400:kworker.0 00000100:00100000:1.0:1790391783.459554:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391783.465164:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186579328 00000100:00100000:3.0:1790391783.465180:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186579328 00000100:00100000:3.0:1790391783.466583:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186579840 00000100:00100000:3.0:1790391783.466597:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186579840 00000100:00100000:3.0:1790391783.466632:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186580352 00000100:00100000:3.0:1790391783.466635:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186580352 00000100:00100000:3.0:1790391783.466674:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790391783.466684:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877361186579328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391783.466819:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877361186579328:12345-0@lo:400:kworker.0 Request processed in 135us (7405us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391783.466828:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790391783.466847:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790391783.466853:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877361186579840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391783.466902:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877361186579840:12345-0@lo:400:kworker.0 Request processed in 49us (7406us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391783.466909:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790391783.466921:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790391783.466928:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877361186580352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391783.466957:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877361186580352:12345-0@lo:400:kworker.0 Request processed in 30us (7402us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391783.466963:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1790391783.466986:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1790391783.468753:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51838f5f80 x1877361186580352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391783.468803:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1877361186580352:0@lo:400:kworker.0 00010000:00080000:0.0:1790391783.468848:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183b7c380 x1877361186579328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391783.468856:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877361186579328:0@lo:400:kworker.0 00010000:00080000:0.0:1790391783.468867:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183b7c000 x1877361186579840/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391783.468892:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877361186579840:0@lo:400:kworker.0 00000100:00100000:2.0:1790391783.469650:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391783.469762:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169682048 00000100:00100000:3.0:1790391783.469769:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169682048 00000100:00100000:3.0:1790391783.469810:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 13 00000100:00100000:3.0:1790391783.469820:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf94b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+6:18123:x1877361169682048:12345-192.168.202.28@tcp:101:mkdir.0 00010000:00010000:3.0:1790391783.469837:0:22777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391783.469859:0:22777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ca00/0x2b1b7949f13e2e74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0712 expref: -99 pid: 22777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391783.469941:0:22777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d400/0x2b1b7949f13e2e7b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391783.469951:0:22777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d400/0x2b1b7949f13e2e7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391783.469969:0:22777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d400/0x2b1b7949f13e2e7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391783.470008:0:22777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790391783.470011:0:22777:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790391783.470049:0:22777:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d400/0x2b1b7949f13e2e7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391783.470069:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ca00/0x2b1b7949f13e2e74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0712 expref: 8 pid: 22777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391783.470081:0:22777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d400/0x2b1b7949f13e2e7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0712 expref: 7 pid: 22777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391783.470087:0:22777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e52b9b70200) 00010000:00010000:3.0:1790391783.470089:0:22777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790391783.470091:0:22777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52bab9d400, rc 0) 00000100:00100000:3.0:1790391783.470136:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf94b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+7:18123:x1877361169682048:12345-192.168.202.28@tcp:101:mkdir.0 Request processed in 317us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391783.470142:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 13 00000040:00080000:3.0:1790391784.008777:0:22810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790391784.264300:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790391784.459662:0:25101:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c67287cd-8d89-444e-807d-10aa5015d6e5 00000001:00080000:3.0:1790391784.459680:0:25101:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00010000:00010000:1.0:1790391785.288192:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391785.386120:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391785.386227:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169682176 00000100:00100000:2.0:1790391785.386240:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169682176 00000100:00080000:0.0:1790391785.386315:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790391785.386327:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 14 00000100:00100000:2.0:1790391785.386339:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c67287cd-8d89-444e-807d-10aa5015d6e5+7:18175:x1877361169682176:12345-192.168.202.28@tcp:41:lfs.0 00000004:00000024:2.0:1790391785.386396:0:22778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1790391785.386504:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c67287cd-8d89-444e-807d-10aa5015d6e5+7:18175:x1877361169682176:12345-192.168.202.28@tcp:41:lfs.0 Request processed in 168us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391785.386511:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 14 00000100:00100000:2.0:1790391785.388802:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391785.389155:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169682304 00000100:00100000:3.0:1790391785.389236:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169682304 00000100:00080000:0.0:1790391785.389404:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790391785.389504:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 15 00000100:00100000:3.0:1790391785.389516:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf94b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+6:18175:x1877361169682304:12345-192.168.202.28@tcp:41:lfs.0 00000004:00000024:3.0:1790391785.389600:0:22777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1790391785.389693:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf94b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+6:18175:x1877361169682304:12345-192.168.202.28@tcp:41:lfs.0 Request processed in 180us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391785.389701:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 15 00000100:00100000:0.0:1790391785.393413:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391785.393519:0:24288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169682432 00000100:00100000:2.0:1790391785.393531:0:24288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169682432 00000100:00100000:2.0:1790391785.393616:0:24288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 12 00000100:00100000:2.0:1790391785.393627:0:24288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183ba8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c67287cd-8d89-444e-807d-10aa5015d6e5+6:18175:x1877361169682432:12345-192.168.202.28@tcp:13:lfs.0 00002000:00000024:2.0:1790391785.393664:0:24288:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1790391785.393758:0:24288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183ba8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c67287cd-8d89-444e-807d-10aa5015d6e5+6:18175:x1877361169682432:12345-192.168.202.28@tcp:13:lfs.0 Request processed in 133us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391785.393765:0:24288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 12 00000100:00080000:0.0:1790391785.394349:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790391785.396454:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391785.396602:0:24288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169682560 00000100:00100000:2.0:1790391785.396612:0:24288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169682560 00000100:00080000:0.0:1790391785.396666:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790391785.396680:0:24288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 13 00000100:00100000:2.0:1790391785.396691:0:24288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183ba8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c67287cd-8d89-444e-807d-10aa5015d6e5+5:18175:x1877361169682560:12345-192.168.202.28@tcp:13:lfs.0 00002000:00000024:2.0:1790391785.396722:0:24288:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1790391785.396811:0:24288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183ba8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c67287cd-8d89-444e-807d-10aa5015d6e5+5:18175:x1877361169682560:12345-192.168.202.28@tcp:13:lfs.0 Request processed in 122us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391785.396836:0:24288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 13 00000100:00100000:3.0:1790391785.574645:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391785.574717:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169682688 00000100:00100000:2.0:1790391785.574728:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169682688 00000100:00100000:2.0:1790391785.574811:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 133 00000100:00100000:2.0:1790391785.574823:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87c34307-e556-4f71-950f-f0a41a7cdef6+10:18210:x1877361169682688:12345-192.168.202.28@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790391785.574840:0:22770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391785.574861:0:22770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52a7efba00/0x2b1b7949f13e2e82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0719 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391785.574921:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52a7efba00/0x2b1b7949f13e2e82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0719 expref: 11 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391785.574934:0:22770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52a7efba00/0x2b1b7949f13e2e82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0719 expref: 11 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391785.574943:0:22770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52a7efba00, rc 0) 00000100:00100000:2.0:1790391785.575066:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87c34307-e556-4f71-950f-f0a41a7cdef6+11:18210:x1877361169682688:12345-192.168.202.28@tcp:101:mount.lustre.0 Request processed in 245us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391785.575075:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 133 00000100:00100000:0.0:1790391785.588917:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391785.589909:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169682816 00000100:00100000:3.0:1790391785.589920:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169682816 00000100:00100000:3.0:1790391785.590079:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 134 00000100:00100000:3.0:1790391785.590090:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87c34307-e556-4f71-950f-f0a41a7cdef6+11:18210:x1877361169682816:12345-192.168.202.28@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790391785.590274:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87c34307-e556-4f71-950f-f0a41a7cdef6+11:18210:x1877361169682816:12345-192.168.202.28@tcp:501:mount.lustre.0 Request processed in 185us (1370us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391785.590282:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 134 00000100:00100000:1.0:1790391785.596507:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391785.607532:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169682944 00000100:00100000:0.0:1790391785.607548:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169682944 00000100:00100000:0.0:1790391785.607703:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 135 00000100:00100000:0.0:1790391785.607714:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87c34307-e556-4f71-950f-f0a41a7cdef6+11:18210:x1877361169682944:12345-192.168.202.28@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790391785.607932:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87c34307-e556-4f71-950f-f0a41a7cdef6+11:18210:x1877361169682944:12345-192.168.202.28@tcp:503:mount.lustre.0 Request processed in 219us (11435us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391785.607942:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 135 00000100:00100000:3.0:1790391785.613206:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391785.613270:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169683072 00000100:00100000:2.0:1790391785.613281:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169683072 00000100:00100000:2.0:1790391785.613444:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 136 00000100:00100000:2.0:1790391785.613455:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87c34307-e556-4f71-950f-f0a41a7cdef6+11:18214:x1877361169683072:12345-192.168.202.28@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790391785.613621:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87c34307-e556-4f71-950f-f0a41a7cdef6+11:18214:x1877361169683072:12345-192.168.202.28@tcp:502:llog_process_th.0 Request processed in 167us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391785.613629:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 136 00000100:00100000:1.0:1790391785.642997:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391785.645385:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169683200 00000100:00100000:3.0:1790391785.645401:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169683200 00000100:00100000:3.0:1790391785.645467:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 137 00000100:00100000:3.0:1790391785.645477:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87c34307-e556-4f71-950f-f0a41a7cdef6+11:18214:x1877361169683200:12345-192.168.202.28@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790391785.645652:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87c34307-e556-4f71-950f-f0a41a7cdef6+11:18214:x1877361169683200:12345-192.168.202.28@tcp:502:llog_process_th.0 Request processed in 175us (2664us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391785.645660:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 137 00000100:00100000:1.0:1790391785.651011:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391785.651455:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169683328 00000100:00100000:2.0:1790391785.651466:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169683328 00000100:00100000:2.0:1790391785.651523:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 138 00000100:00100000:2.0:1790391785.651532:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87c34307-e556-4f71-950f-f0a41a7cdef6+11:18214:x1877361169683328:12345-192.168.202.28@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790391785.651687:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87c34307-e556-4f71-950f-f0a41a7cdef6+11:18214:x1877361169683328:12345-192.168.202.28@tcp:502:llog_process_th.0 Request processed in 156us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391785.651694:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 138 00000100:00100000:1.0:1790391785.661618:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391785.662095:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169683456 00000100:00100000:0.0:1790391785.662105:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169683456 00000100:00100000:0.0:1790391785.662181:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 139 00000100:00100000:0.0:1790391785.662192:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87c34307-e556-4f71-950f-f0a41a7cdef6+11:18210:x1877361169683456:12345-192.168.202.28@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790391785.662210:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391785.662228:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5295144800/0x2b1b7949f13e2e89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b074a expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391785.662259:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5295144800/0x2b1b7949f13e2e89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b074a expref: 12 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391785.662271:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5295144800/0x2b1b7949f13e2e89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b074a expref: 12 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391785.662280:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5295144800, rc 0) 00000100:00100000:0.0:1790391785.663432:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87c34307-e556-4f71-950f-f0a41a7cdef6+12:18210:x1877361169683456:12345-192.168.202.28@tcp:101:mount.lustre.0 Request processed in 1234us (1815us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391785.663442:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 139 00000100:00100000:1.0:1790391785.667665:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391785.667750:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169683584 00000100:00100000:3.0:1790391785.667760:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169683584 00000100:00100000:3.0:1790391785.667814:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 140 00000100:00100000:3.0:1790391785.667826:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87c34307-e556-4f71-950f-f0a41a7cdef6+12:18210:x1877361169683584:12345-192.168.202.28@tcp:256:mount.lustre.0 20000000:01000000:3.0:1790391785.667853:0:22770:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1790391785.667921:0:22770:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1790391785.667926:0:22770:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1790391785.667929:0:22770:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1790391785.667932:0:22770:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1790391785.667935:0:22770:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:3.0:1790391785.670709:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87c34307-e556-4f71-950f-f0a41a7cdef6+12:18210:x1877361169683584:12345-192.168.202.28@tcp:256:mount.lustre.0 Request processed in 2875us (3041us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391785.670722:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 140 00000100:00100000:1.0:1790391785.673620:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391785.673899:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169683712 00000100:00100000:2.0:1790391785.673908:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169683712 00000100:00100000:2.0:1790391785.673998:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 141 00000100:00100000:2.0:1790391785.674009:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282b66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87c34307-e556-4f71-950f-f0a41a7cdef6+12:18210:x1877361169683712:12345-192.168.202.28@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790391785.674037:0:22769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391785.674054:0:22769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52a7efa400/0x2b1b7949f13e2e90 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0751 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391785.674085:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52a7efa400/0x2b1b7949f13e2e90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0751 expref: 13 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391785.674096:0:22769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52a7efa400/0x2b1b7949f13e2e90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0751 expref: 13 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391785.674105:0:22769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52a7efa400, rc 0) 00000100:00100000:2.0:1790391785.674153:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282b66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87c34307-e556-4f71-950f-f0a41a7cdef6+13:18210:x1877361169683712:12345-192.168.202.28@tcp:101:mount.lustre.0 Request processed in 146us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391785.674159:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 141 00000100:00100000:1.0:1790391785.676591:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391785.677136:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169683840 00000100:00100000:0.0:1790391785.677145:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169683840 00000100:00100000:0.0:1790391785.677182:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 142 00000100:00100000:0.0:1790391785.677189:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282bd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87c34307-e556-4f71-950f-f0a41a7cdef6+13:18210:x1877361169683840:12345-192.168.202.28@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790391785.677352:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282bd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87c34307-e556-4f71-950f-f0a41a7cdef6+13:18210:x1877361169683840:12345-192.168.202.28@tcp:501:mount.lustre.0 Request processed in 161us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391785.677361:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 142 00000100:00100000:1.0:1790391785.678919:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391785.678968:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169683968 00000100:00100000:0.0:1790391785.678976:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169683968 00000100:00100000:0.0:1790391785.679098:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 143 00000100:00100000:0.0:1790391785.679106:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282bda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87c34307-e556-4f71-950f-f0a41a7cdef6+13:18210:x1877361169683968:12345-192.168.202.28@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790391785.679218:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282bda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87c34307-e556-4f71-950f-f0a41a7cdef6+13:18210:x1877361169683968:12345-192.168.202.28@tcp:503:mount.lustre.0 Request processed in 112us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391785.679225:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 143 00000100:00100000:1.0:1790391785.682145:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391785.682194:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169684096 00000100:00100000:3.0:1790391785.682202:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169684096 00000100:00100000:3.0:1790391785.682301:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 144 00000100:00100000:3.0:1790391785.682312:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282bda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87c34307-e556-4f71-950f-f0a41a7cdef6+13:18220:x1877361169684096:12345-192.168.202.28@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790391785.682465:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282bda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87c34307-e556-4f71-950f-f0a41a7cdef6+13:18220:x1877361169684096:12345-192.168.202.28@tcp:502:llog_process_th.0 Request processed in 154us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391785.682474:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 144 00000100:00100000:1.0:1790391785.686947:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391785.687203:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169684224 00000100:00100000:0.0:1790391785.687215:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169684224 00000100:00100000:0.0:1790391785.687301:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 145 00000100:00100000:0.0:1790391785.687312:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282bdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87c34307-e556-4f71-950f-f0a41a7cdef6+13:18220:x1877361169684224:12345-192.168.202.28@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790391785.687529:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282bdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87c34307-e556-4f71-950f-f0a41a7cdef6+13:18220:x1877361169684224:12345-192.168.202.28@tcp:502:llog_process_th.0 Request processed in 218us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391785.687538:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 145 00000100:00100000:1.0:1790391785.700929:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391785.701084:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391785.710341:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169684352 00000100:00100000:2.0:1790391785.710362:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169684352 00000100:00100000:2.0:1790391785.710443:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169684608 00000100:00100000:2.0:1790391785.710446:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169684608 00000100:00100000:2.0:1790391785.710474:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 16 00000100:00100000:2.0:1790391785.710483:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2380:x1877361169684352:12345-192.168.202.28@tcp:38:mount.lustre.0 00010000:00080000:2.0:1790391785.710515:0:22778:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 06a5f5e7-5ead-4721-91c8-25641992d7dd@192.168.202.28@tcp t0 exp 0000000000000000 cur 699 last 0 00000020:00000080:2.0:1790391785.710552:0:22778:0:(genops.c:1385:class_connect()) connect: client 06a5f5e7-5ead-4721-91c8-25641992d7dd, cookie 0x2b1b7949f13e2e97 00000004:00100000:2.0:1790391785.710578:0:22778:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1790391785.710691:0:22778:0:(import.c:65:import_set_state_nolock()) ffff9e52a494a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790391785.710779:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06a5f5e7-5ead-4721-91c8-25641992d7dd+6:2380:x1877361169684352:12345-192.168.202.28@tcp:38:mount.lustre.0 Request processed in 295us (9860us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391785.710787:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 16 00000100:00100000:2.0:1790391785.710806:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 17 00000100:00100000:2.0:1790391785.710811:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2380:x1877361169684608:12345-192.168.202.28@tcp:38:mount.lustre.0 00010000:00080000:2.0:1790391785.710828:0:22778:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 06a5f5e7-5ead-4721-91c8-25641992d7dd@192.168.202.28@tcp t0 exp 0000000000000000 cur 699 last 0 00000020:00000080:2.0:1790391785.710850:0:22778:0:(genops.c:1385:class_connect()) connect: client 06a5f5e7-5ead-4721-91c8-25641992d7dd, cookie 0x2b1b7949f13e2e9e 00000004:00100000:2.0:1790391785.710864:0:22778:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1790391785.710930:0:22778:0:(import.c:65:import_set_state_nolock()) ffff9e52a4948000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790391785.710955:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06a5f5e7-5ead-4721-91c8-25641992d7dd+6:2380:x1877361169684608:12345-192.168.202.28@tcp:38:mount.lustre.0 Request processed in 141us (9871us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391785.710962:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 17 00000100:00100000:1.0:1790391785.728251:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391785.728314:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391785.728445:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169684736 00000100:00100000:0.0:1790391785.728455:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169684736 00000100:00100000:0.0:1790391785.728529:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169684480 00000100:00100000:0.0:1790391785.728533:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169684480 00000100:00100000:0.0:1790391785.728559:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 18 00000100:00100000:0.0:1790391785.728568:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06a5f5e7-5ead-4721-91c8-25641992d7dd+6:0:x1877361169684736:12345-192.168.202.28@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790391785.728605:0:22777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790391785.728673:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06a5f5e7-5ead-4721-91c8-25641992d7dd+6:0:x1877361169684736:12345-192.168.202.28@tcp:41:mount.lustre.0 Request processed in 106us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391785.728681:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 18 00000100:00100000:0.0:1790391785.728698:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 19 00000100:00100000:0.0:1790391785.728705:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06a5f5e7-5ead-4721-91c8-25641992d7dd+6:0:x1877361169684480:12345-192.168.202.28@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790391785.728721:0:22777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1790391785.728760:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06a5f5e7-5ead-4721-91c8-25641992d7dd+6:0:x1877361169684480:12345-192.168.202.28@tcp:41:mount.lustre.0 Request processed in 56us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391785.728780:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 19 00000100:00080000:3.0:1790391785.729233:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790391785.729238:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790391785.731110:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391785.731203:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169684864 00000100:00100000:0.0:1790391785.731211:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169684864 00000100:00100000:0.0:1790391785.731268:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 20 00000100:00100000:0.0:1790391785.731278:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf94a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06a5f5e7-5ead-4721-91c8-25641992d7dd+6:18210:x1877361169684864:12345-192.168.202.28@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790391785.731326:0:22777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1790391785.731567:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf94a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06a5f5e7-5ead-4721-91c8-25641992d7dd+6:18210:x1877361169684864:12345-192.168.202.28@tcp:41:mount.lustre.0 Request processed in 289us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391785.731575:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 20 00000100:00100000:0.0:1790391785.737509:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391785.737598:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169684992 00000100:00100000:1.0:1790391785.737608:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169684992 00000100:00100000:1.0:1790391785.737669:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 21 00000100:00100000:1.0:1790391785.737679:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06a5f5e7-5ead-4721-91c8-25641992d7dd+6:18210:x1877361169684992:12345-192.168.202.28@tcp:40:mount.lustre.0 00000100:00100000:1.0:1790391785.737782:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06a5f5e7-5ead-4721-91c8-25641992d7dd+6:18210:x1877361169684992:12345-192.168.202.28@tcp:40:mount.lustre.0 Request processed in 104us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391785.737789:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 21 00000100:00100000:2.0:1790391785.744312:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391785.744354:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391785.744394:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391785.744516:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169685376 00000100:00100000:0.0:1790391785.744526:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169685376 00000100:00100000:0.0:1790391785.744585:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 4 00000100:00100000:0.0:1790391785.744595:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf94a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:06a5f5e7-5ead-4721-91c8-25641992d7dd+6:18210:x1877361169685376:12345-192.168.202.28@tcp:900:mount.lustre.0 00000100:00100000:0.0:1790391785.744673:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf94a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:06a5f5e7-5ead-4721-91c8-25641992d7dd+6:18210:x1877361169685376:12345-192.168.202.28@tcp:900:mount.lustre.0 Request processed in 80us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391785.744681:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 4 00000100:00100000:1.0:1790391785.744948:0:24285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169685120 00000100:00100000:1.0:1790391785.744953:0:24285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169685120 00000100:00100000:1.0:1790391785.744983:0:24285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169685248 00000100:00100000:1.0:1790391785.744986:0:24285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169685248 00000100:00100000:1.0:1790391785.745003:0:24285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 21 00000100:00100000:1.0:1790391785.745008:0:24285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf949c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2380:x1877361169685120:12345-192.168.202.28@tcp:8:mount.lustre.0 00010000:00080000:1.0:1790391785.745035:0:24285:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 06a5f5e7-5ead-4721-91c8-25641992d7dd@192.168.202.28@tcp t0 exp 0000000000000000 cur 699 last 0 00000020:00000080:1.0:1790391785.745065:0:24285:0:(genops.c:1385:class_connect()) connect: client 06a5f5e7-5ead-4721-91c8-25641992d7dd, cookie 0x2b1b7949f13e2ea5 00002000:00100000:1.0:1790391785.745076:0:24285:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 06a5f5e7-5ead-4721-91c8-25641992d7dd/ffff9e52afc93000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790391785.745088:0:24285:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790391785.745159:0:24285:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1790391785.745215:0:24285:0:(import.c:65:import_set_state_nolock()) ffff9e52a7e7e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790391785.745255:0:24285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf949c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:06a5f5e7-5ead-4721-91c8-25641992d7dd+6:2380:x1877361169685120:12345-192.168.202.28@tcp:8:mount.lustre.0 Request processed in 245us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391785.745261:0:24285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 21 00000100:00100000:1.0:1790391785.745274:0:24285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 22 00000100:00100000:1.0:1790391785.745278:0:24285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf949880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2380:x1877361169685248:12345-192.168.202.28@tcp:8:mount.lustre.0 00010000:00080000:1.0:1790391785.745295:0:24285:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 06a5f5e7-5ead-4721-91c8-25641992d7dd@192.168.202.28@tcp t0 exp 0000000000000000 cur 699 last 0 00000020:00000080:1.0:1790391785.745310:0:24285:0:(genops.c:1385:class_connect()) connect: client 06a5f5e7-5ead-4721-91c8-25641992d7dd, cookie 0x2b1b7949f13e2eac 00002000:00100000:1.0:1790391785.745324:0:24285:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 06a5f5e7-5ead-4721-91c8-25641992d7dd/ffff9e52a7e7b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790391785.745331:0:24285:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790391785.745372:0:24285:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1790391785.745385:0:24285:0:(import.c:65:import_set_state_nolock()) ffff9e52a7e7b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790391785.745405:0:24285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf949880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:06a5f5e7-5ead-4721-91c8-25641992d7dd+6:2380:x1877361169685248:12345-192.168.202.28@tcp:8:mount.lustre.0 Request processed in 125us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391785.745412:0:24285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 22 00000100:00100000:2.0:1790391785.748112:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391785.748449:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169685504 00000100:00100000:1.0:1790391785.748460:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169685504 00000100:00100000:1.0:1790391785.748545:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 1 00000100:00100000:1.0:1790391785.748556:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf948700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:06a5f5e7-5ead-4721-91c8-25641992d7dd+6:18210:x1877361169685504:12345-192.168.202.28@tcp:33:mount.lustre.0 00000004:00200000:1.0:1790391785.748645:0:22780:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1790391785.748781:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf948700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:06a5f5e7-5ead-4721-91c8-25641992d7dd+6:18210:x1877361169685504:12345-192.168.202.28@tcp:33:mount.lustre.0 Request processed in 226us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391785.748789:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 1 00000100:00100000:3.0:1790391785.912134:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391785.912248:0:23840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169685632 00000100:00100000:1.0:1790391785.912258:0:23840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169685632 00000100:00100000:1.0:1790391785.912334:0:23840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 22 00000100:00100000:1.0:1790391785.912344:0:23840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:06a5f5e7-5ead-4721-91c8-25641992d7dd+6:18243:x1877361169685632:12345-192.168.202.28@tcp:101:mkdir.0 00010000:00010000:1.0:1790391785.912365:0:23840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391785.912386:0:23840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055e00/0x2b1b7949f13e2eb3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0782 expref: -99 pid: 23840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391785.912456:0:23840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055a00/0x2b1b7949f13e2eba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391785.912470:0:23840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055a00/0x2b1b7949f13e2eba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391785.912487:0:23840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055a00/0x2b1b7949f13e2eba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391785.912527:0:23840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1790391785.912531:0:23840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790391785.912549:0:23840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055a00/0x2b1b7949f13e2eba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391785.912572:0:23840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055e00/0x2b1b7949f13e2eb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0782 expref: 8 pid: 23840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391785.912591:0:23840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055a00/0x2b1b7949f13e2eba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0782 expref: 7 pid: 23840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391785.912599:0:23840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e52b9b70200) 00010000:00010000:1.0:1790391785.912603:0:23840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790391785.912606:0:23840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5184055a00, rc 0) 00000100:00100000:1.0:1790391785.913025:0:23840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:06a5f5e7-5ead-4721-91c8-25641992d7dd+7:18243:x1877361169685632:12345-192.168.202.28@tcp:101:mkdir.0 Request processed in 680us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391785.913039:0:23840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 22 00010000:00010000:1.0:1790391786.312264:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391787.017212:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790391787.017240:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf948000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186580736:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790391787.017335:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186580864:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790391787.017357:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391787.017429:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186580736 00000100:00100000:3.0:1790391787.017436:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186580736 00000100:00100000:1.0:1790391787.017488:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391787.017495:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790391787.017507:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186580736:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790391787.017527:0:24288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186580864 00000100:00100000:1.0:1790391787.017532:0:24288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186580864 00000004:00000024:3.0:1790391787.017543:0:22782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1790391787.017570:0:24288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790391787.017578:0:24288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186580864:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790391787.017600:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186580736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (242us total) trans 0 rc 0/0 00002000:00000024:1.0:1790391787.017600:0:24288:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1790391787.017623:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790391787.017640:0:24288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186580864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391787.017648:0:24288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1790391787.017654:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790391787.017694:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186580864:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790391787.017696:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf948000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186580736:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1790391787.345761:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391787.534364:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186580992:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790391787.534453:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391787.541153:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186580992 00000100:00100000:3.0:1790391787.541168:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186580992 00000100:00100000:2.0:1790391787.541327:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790391787.541354:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183baa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186580992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790391787.541395:0:22782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790391787.541484:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183baa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186580992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 132us (7033us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391787.541491:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790391787.542121:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186580992:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790391788.051694:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186581120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790391788.051787:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391788.055734:0:24288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186581120 00000100:00100000:2.0:1790391788.055751:0:24288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186581120 00000100:00100000:2.0:1790391788.055844:0:24288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790391788.055855:0:24288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183ba9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186581120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790391788.055901:0:24288:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1790391788.055987:0:24288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183ba9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186581120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (4200us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391788.055995:0:24288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790391788.056046:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186581120:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790391788.056160:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790391788.360980:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790391788.556513:0:24280:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 06a5f5e7-5ead-4721-91c8-25641992d7dd 00000001:00100000:1.0:1790391788.556525:0:24280:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c67287cd-8d89-444e-807d-10aa5015d6e5 00000001:00100000:1.0:1790391788.556547:0:23510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 06a5f5e7-5ead-4721-91c8-25641992d7dd 00000001:00100000:1.0:1790391788.556561:0:23510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of c67287cd-8d89-444e-807d-10aa5015d6e5 00000001:00100000:1.0:1790391788.556582:0:22756:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 06a5f5e7-5ead-4721-91c8-25641992d7dd 00000001:00100000:1.0:1790391788.556588:0:22756:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c67287cd-8d89-444e-807d-10aa5015d6e5 00000100:00100000:1.0:1790391788.562174:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186581248:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790391788.562267:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391788.562336:0:24288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186581248 00000100:00100000:1.0:1790391788.562344:0:24288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186581248 00000100:00100000:1.0:1790391788.562407:0:24288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790391788.562416:0:24288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186581248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790391788.562444:0:24288:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1790391788.562489:0:24288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186581248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391788.562496:0:24288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790391788.562543:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186581248:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790391788.563080:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186581376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790391788.563111:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391788.563149:0:24288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186581376 00000100:00100000:1.0:1790391788.563153:0:24288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186581376 00000100:00100000:1.0:1790391788.563176:0:24288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790391788.563181:0:24288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186581376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790391788.563192:0:24288:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1790391788.563230:0:24288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186581376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391788.563236:0:24288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790391788.563260:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1790391788.563276:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186581376:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1790391788.575146:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790391788.578705:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e907dcd1-fffe-43bb-853f-376b925bb229:3640:1877361186581504:0@lo:400:kworker.0 00000100:00100000:2.0:1790391788.578793:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391788.578835:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186582016:0@lo:400:kworker.0 00000100:00100000:2.0:1790391788.578862:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391788.578898:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1877361186582528:0@lo:400:kworker.0 00000100:00100000:2.0:1790391788.578986:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391788.579012:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1790391788.579017:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf948000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186581888:0@lo:400:kworker.0 00000100:00100000:2.0:1790391788.579041:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391788.579059:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288344000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1877361186582400:0@lo:400:kworker.0 00000100:00100000:2.0:1790391788.579079:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391788.579119:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186581504 00000100:00100000:2.0:1790391788.579126:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186581504 00000100:00100000:2.0:1790391788.579184:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1790391788.579192:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282bdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+24:3640:x1877361186581504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391788.579240:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282bdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+24:3640:x1877361186581504:12345-0@lo:400:kworker.0 Request processed in 49us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391788.579247:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1790391788.579277:0:24285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186582016 00000100:00100000:2.0:1790391788.579281:0:24285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186582016 00000100:00100000:2.0:1790391788.582376:0:24285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790391788.582390:0:24285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186582016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391788.582476:0:24285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186582016:12345-0@lo:400:kworker.0 Request processed in 89us (3612us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391788.582484:0:24285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790391788.582516:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186582528 00000100:00100000:2.0:1790391788.582523:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186582528 00000100:00100000:2.0:1790391788.582564:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186582400 00000100:00100000:2.0:1790391788.582567:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186582400 00000100:00100000:2.0:1790391788.582590:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790391788.582597:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877361186582528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391788.582632:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877361186582528:12345-0@lo:400:kworker.0 Request processed in 36us (3646us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391788.582639:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790391788.582651:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790391788.582657:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877361186582400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391788.582683:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877361186582400:12345-0@lo:400:kworker.0 Request processed in 26us (3603us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391788.582705:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790391788.582738:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186581888 00000100:00100000:2.0:1790391788.582743:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186581888 00000100:00100000:2.0:1790391788.582770:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790391788.582775:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186581888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391788.582810:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186581888:12345-0@lo:400:kworker.0 Request processed in 34us (3768us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391788.582816:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790391788.583014:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf948a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186581632:0@lo:400:kworker.0 00000100:00100000:2.0:1790391788.583047:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391788.583068:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186582144:0@lo:400:kworker.0 00000100:00100000:2.0:1790391788.583086:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391788.583099:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1877361186582656:0@lo:400:kworker.0 00000100:00100000:2.0:1790391788.583120:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391788.583136:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1790391788.583142:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf949f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877361186581760:0@lo:400:kworker.0 00000100:00100000:2.0:1790391788.583160:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391788.583172:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288346680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1877361186582272:0@lo:400:kworker.0 00000100:00100000:2.0:1790391788.583189:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391788.583209:0:23840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186582144 00000100:00100000:2.0:1790391788.583213:0:23840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186582144 00000100:00100000:2.0:1790391788.583230:0:23840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186582656 00000100:00100000:2.0:1790391788.583232:0:23840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186582656 00000100:00100000:2.0:1790391788.583246:0:23840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186581760 00000100:00100000:2.0:1790391788.583248:0:23840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186581760 00000100:00100000:2.0:1790391788.583258:0:23840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186582272 00000100:00100000:2.0:1790391788.583267:0:23840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186582272 00000100:00100000:2.0:1790391788.583283:0:23840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790391788.583288:0:23840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186582144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391788.583321:0:23840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186582144:12345-0@lo:400:kworker.0 Request processed in 33us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391788.583327:0:23840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790391788.583340:0:23840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790391788.583346:0:23840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1877361186582656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391788.583372:0:23840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1877361186582656:12345-0@lo:400:kworker.0 Request processed in 27us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391788.583378:0:23840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790391788.583388:0:23840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790391788.583393:0:23840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877361186581760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391788.583413:0:23840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877361186581760:12345-0@lo:400:kworker.0 Request processed in 20us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391788.583418:0:23840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790391788.583427:0:23840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790391788.583432:0:23840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1877361186582272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391788.583453:0:23840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1877361186582272:12345-0@lo:400:kworker.0 Request processed in 22us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391788.583459:0:23840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790391788.583478:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186581632 00000100:00100000:2.0:1790391788.583482:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186581632 00000100:00100000:2.0:1790391788.583501:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790391788.583506:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186581632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391788.583533:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186581632:12345-0@lo:400:kworker.0 Request processed in 27us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391788.583544:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790391788.583587:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf949f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877361186581760:0@lo:400:kworker.0 00000100:00100000:2.0:1790391788.583598:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288346680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1877361186582272:0@lo:400:kworker.0 00000100:00100000:2.0:1790391788.583607:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf948a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186581632:0@lo:400:kworker.0 00000100:00100000:2.0:1790391788.583615:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186582144:0@lo:400:kworker.0 00010000:00080000:2.0:1790391788.583625:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518229f100 x1877361186582656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391788.583634:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1877361186582656:0@lo:400:kworker.0 00000100:00100000:2.0:1790391788.583677:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf948000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186581888:0@lo:400:kworker.0 00010000:00080000:2.0:1790391788.583689:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5288344000 x1877361186582400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391788.583697:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288344000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1877361186582400:0@lo:400:kworker.0 00000100:00100000:2.0:1790391788.583717:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e907dcd1-fffe-43bb-853f-376b925bb229:3640:1877361186581504:0@lo:400:kworker.0 00000100:00100000:2.0:1790391788.583730:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186582016:0@lo:400:kworker.0 00000100:00100000:2.0:1790391788.583739:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1877361186582528:0@lo:400:kworker.0 00000100:00080000:3.0:1790391788.592077:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790391788.592087:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1790391788.708419:0:25657:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1790391789.384412:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391790.410480:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391790.986567:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391790.986598:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391790.986616:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391790.986639:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391790.986656:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391790.986705:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391790.986725:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391790.986744:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391790.986770:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391790.986798:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169685760 00000100:00100000:2.0:1790391790.986809:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169685760 00000100:00100000:2.0:1790391790.986860:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 147 00000100:00100000:2.0:1790391790.986870:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282bd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87c34307-e556-4f71-950f-f0a41a7cdef6+13:2384:x1877361169685760:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391790.986955:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282bd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87c34307-e556-4f71-950f-f0a41a7cdef6+13:2384:x1877361169685760:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 87us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391790.986963:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 147 00000100:00100000:2.0:1790391790.986995:0:23840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169686016 00000100:00100000:2.0:1790391790.986999:0:23840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169686016 00000100:00100000:2.0:1790391790.987031:0:23840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169686528 00000100:00100000:2.0:1790391790.987034:0:23840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169686528 00000100:00100000:2.0:1790391790.987048:0:23840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169685888 00000100:00100000:2.0:1790391790.987050:0:23840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169685888 00000100:00100000:2.0:1790391790.987061:0:23840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169686400 00000100:00100000:2.0:1790391790.987064:0:23840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169686400 00000100:00100000:2.0:1790391790.987078:0:23840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 45 00000100:00100000:2.0:1790391790.987085:0:23840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c67287cd-8d89-444e-807d-10aa5015d6e5+5:2384:x1877361169686016:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391790.987115:0:23840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c67287cd-8d89-444e-807d-10aa5015d6e5+5:2384:x1877361169686016:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 31us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391790.987122:0:23840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 45 00000100:00100000:2.0:1790391790.987133:0:23840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 46 00000100:00100000:2.0:1790391790.987139:0:23840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:06a5f5e7-5ead-4721-91c8-25641992d7dd+5:2384:x1877361169686528:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391790.987157:0:23840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:06a5f5e7-5ead-4721-91c8-25641992d7dd+5:2384:x1877361169686528:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 19us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391790.987181:0:23840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 46 00000100:00100000:2.0:1790391790.987192:0:23840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 47 00000100:00100000:2.0:1790391790.987198:0:23840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c67287cd-8d89-444e-807d-10aa5015d6e5+6:2384:x1877361169685888:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391790.987222:0:23840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c67287cd-8d89-444e-807d-10aa5015d6e5+6:2384:x1877361169685888:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 24us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391790.987227:0:23840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 47 00000100:00100000:2.0:1790391790.987237:0:23840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 48 00000100:00100000:2.0:1790391790.987243:0:23840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:06a5f5e7-5ead-4721-91c8-25641992d7dd+6:2384:x1877361169686400:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391790.987282:0:23840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:06a5f5e7-5ead-4721-91c8-25641992d7dd+6:2384:x1877361169686400:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 38us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391790.987288:0:23840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 48 00000100:00100000:2.0:1790391790.987310:0:24284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169686272 00000100:00100000:2.0:1790391790.987313:0:24284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169686272 00000100:00100000:2.0:1790391790.987334:0:24284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169686784 00000100:00100000:2.0:1790391790.987337:0:24284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169686784 00000100:00100000:2.0:1790391790.987348:0:24284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169686144 00000100:00100000:2.0:1790391790.987350:0:24284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169686144 00000100:00100000:2.0:1790391790.987360:0:24284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169686656 00000100:00100000:2.0:1790391790.987362:0:24284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169686656 00000100:00100000:2.0:1790391790.987374:0:24284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 8 00000100:00100000:2.0:1790391790.987379:0:24284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+5:2384:x1877361169686272:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391790.987415:0:24284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+5:2384:x1877361169686272:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 35us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391790.987421:0:24284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 8 00000100:00100000:2.0:1790391790.987431:0:24284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 9 00000100:00100000:2.0:1790391790.987442:0:24284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:06a5f5e7-5ead-4721-91c8-25641992d7dd+6:2384:x1877361169686784:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391790.987461:0:24284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:06a5f5e7-5ead-4721-91c8-25641992d7dd+6:2384:x1877361169686784:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 20us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391790.987466:0:24284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 9 00000100:00100000:2.0:1790391790.987475:0:24284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 10 00000100:00100000:2.0:1790391790.987480:0:24284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+5:2384:x1877361169686144:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391790.987497:0:24284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+5:2384:x1877361169686144:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 17us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391790.987502:0:24284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 10 00000100:00100000:2.0:1790391790.987510:0:24284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 11 00000100:00100000:2.0:1790391790.987515:0:24284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:06a5f5e7-5ead-4721-91c8-25641992d7dd+5:2384:x1877361169686656:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391790.987528:0:24284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:06a5f5e7-5ead-4721-91c8-25641992d7dd+5:2384:x1877361169686656:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 13us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391790.987534:0:24284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 11 00000100:00080000:3.0:1790391790.988209:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790391790.988216:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790391790.988219:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790391790.988221:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1790391791.432150:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790391791.633641:0:25101:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 06a5f5e7-5ead-4721-91c8-25641992d7dd 00000100:00100000:2.0:1790391792.137629:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790391792.137653:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186582784:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790391792.137739:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391792.137942:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186582784 00000100:00100000:3.0:1790391792.137950:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186582784 00000100:00100000:3.0:1790391792.137995:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790391792.138004:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186582784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790391792.138036:0:22782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1790391792.138084:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186582784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391792.138091:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790391792.138130:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186582784:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790391792.139411:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186582912:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790391792.139465:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391792.139540:0:24288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186582912 00000100:00100000:0.0:1790391792.139546:0:24288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186582912 00000100:00100000:0.0:1790391792.139599:0:24288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790391792.139607:0:24288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288344700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186582912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790391792.139634:0:24288:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1790391792.139686:0:24288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288344700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186582912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391792.139692:0:24288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1790391792.139739:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790391792.139772:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186582912:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1790391792.458718:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790391792.462037:0:25804:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe395bf110 20000000:00000080:3.0:1790391792.462054:0:25804:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e52a7efe800 uarg=0000000000000000 20000000:01000000:3.0:1790391792.462093:0:25804:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1790391792.462099:0:25804:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1790391792.462103:0:25804:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1790391792.462806:0:25805:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1790391792.463016:0:25804:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1790391792.472858:0:25804:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790391792.473332:0:25804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e52a7efbc00/0x2b1b7949f13e2ec1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391792.473359:0:25804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5295144400/0x2b1b7949f13e2b1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2b17 expref: 23 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391792.473367:0:25804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5295145600/0x2b1b7949f13e2b2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2b25 expref: 23 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391792.473373:0:25804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5184055c00/0x2b1b7949f13e2b6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2b64 expref: 23 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391792.473380:0:25804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5184054000/0x2b1b7949f13e2ce5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2cde expref: 23 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391792.473390:0:25804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e52bab9d600/0x2b1b7949f13e2e51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b06e1 expref: 12 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391792.473397:0:25804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e52a7efa400/0x2b1b7949f13e2e90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0751 expref: 12 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391792.473405:0:25804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e52a7efbc00/0x2b1b7949f13e2ec1 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391792.473449:0:25804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e52a7efa400/0x2b1b7949f13e2e90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0751 expref: 12 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391792.473465:0:25804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e52a7efa400/0x2b1b7949f13e2e90 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0751 expref: 12 pid: 22769 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391792.473479:0:25804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288344000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25804:1877361186583040:192.168.202.28@tcp:104: 00010000:00010000:2.0:1790391792.473585:0:25804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e52bab9d600/0x2b1b7949f13e2e51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b06e1 expref: 12 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391792.473601:0:25804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e52bab9d600/0x2b1b7949f13e2e51 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b06e1 expref: 12 pid: 22770 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391792.473610:0:25804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288345880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25804:1877361186583168:192.168.202.28@tcp:104: 00010000:00010000:2.0:1790391792.473644:0:25804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5184054000/0x2b1b7949f13e2ce5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e2cde expref: 23 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391792.473653:0:25804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e5184054000/0x2b1b7949f13e2ce5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e2cde expref: 23 pid: 22769 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391792.473662:0:25804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288346680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25804:1877361186583296:0@lo:104: 00000100:00100000:2.0:1790391792.473716:0:25804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790391792.473758:0:25804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5184055c00/0x2b1b7949f13e2b6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e2b64 expref: 23 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391792.473766:0:25804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e5184055c00/0x2b1b7949f13e2b6b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e2b64 expref: 23 pid: 22770 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391792.473774:0:25804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf948000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25804:1877361186583424:0@lo:104: 00000100:00100000:2.0:1790391792.473796:0:25804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790391792.473817:0:25804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5295145600/0x2b1b7949f13e2b2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e2b25 expref: 23 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391792.473825:0:25804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e5295145600/0x2b1b7949f13e2b2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e2b25 expref: 23 pid: 22771 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391792.473833:0:25804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf949f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25804:1877361186583552:0@lo:104: 00000100:00100000:2.0:1790391792.473854:0:25804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790391792.473958:0:25804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5295144400/0x2b1b7949f13e2b1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e2b17 expref: 23 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391792.473967:0:25804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e5295144400/0x2b1b7949f13e2b1e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e2b17 expref: 23 pid: 22771 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391792.473974:0:25804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831bb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25804:1877361186583680:0@lo:104: 00000100:00100000:2.0:1790391792.473997:0:25804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391792.474013:0:25804:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529055dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1790391792.474477:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186583296 00000100:00100000:0.0:1790391792.474490:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186583296 00000100:00100000:0.0:1790391792.474530:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186583424 00000100:00100000:0.0:1790391792.474532:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186583424 00000100:00100000:0.0:1790391792.474543:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186583552 00000100:00100000:0.0:1790391792.474545:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186583552 00000100:00100000:0.0:1790391792.474553:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186583680 00000100:00100000:0.0:1790391792.474556:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186583680 00000100:00100000:0.0:1790391792.474569:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790391792.474576:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf948e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e907dcd1-fffe-43bb-853f-376b925bb229+6:25804:x1877361186583296:12345-0@lo:104: 00010000:00010000:0.0:1790391792.474591:0:22760:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e5280031800/0x2b1b7949f13e2cde lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e2ce5 expref: -99 pid: 25100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391792.474660:0:22760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790391792.474666:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf948e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e907dcd1-fffe-43bb-853f-376b925bb229+6:25804:x1877361186583296:12345-0@lo:104: Request processed in 90us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391792.474681:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790391792.474700:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790391792.474705:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf948a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e907dcd1-fffe-43bb-853f-376b925bb229+5:25804:x1877361186583424:12345-0@lo:104: 00010000:00010000:0.0:1790391792.474723:0:22760:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d000/0x2b1b7949f13e2b64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e2b6b expref: -99 pid: 24279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391792.474766:0:22760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790391792.474772:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf948a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e907dcd1-fffe-43bb-853f-376b925bb229+5:25804:x1877361186583424:12345-0@lo:104: Request processed in 66us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391792.474778:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790391792.474791:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790391792.474797:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e907dcd1-fffe-43bb-853f-376b925bb229+4:25804:x1877361186583552:12345-0@lo:104: 00010000:00010000:0.0:1790391792.474805:0:22760:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e52bab9ce00/0x2b1b7949f13e2b25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e2b2c expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391792.474834:0:22760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1790391792.474838:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e907dcd1-fffe-43bb-853f-376b925bb229+4:25804:x1877361186583552:12345-0@lo:104: Request processed in 43us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391792.474844:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790391792.474857:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790391792.474862:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e907dcd1-fffe-43bb-853f-376b925bb229+3:25804:x1877361186583680:12345-0@lo:104: 00010000:00010000:0.0:1790391792.474869:0:22760:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c800/0x2b1b7949f13e2b17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e2b1e expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391792.475050:0:22760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1790391792.475056:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e907dcd1-fffe-43bb-853f-376b925bb229+3:25804:x1877361186583680:12345-0@lo:104: Request processed in 194us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391792.475062:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1790391792.475078:0:22764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1790391792.475083:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e5280031800/0x2b1b7949f13e2cde lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e2ce5 expref: -99 pid: 25100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391792.475097:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280031800 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:0.0:1790391792.475101:0:22764:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e5280031800/0x2b1b7949f13e2cde lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e2ce5 expref: -99 pid: 25100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391792.475108:0:22764:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5280031800/0x2b1b7949f13e2cde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e2ce5 expref: -99 pid: 25100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790391792.475115:0:22764:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5280031800/0x2b1b7949f13e2cde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e2ce5 expref: -99 pid: 25100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391792.475119:0:22764:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790391792.475149:0:22764:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e5280031800/0x2b1b7949f13e2cde lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e2ce5 expref: -99 pid: 25100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391792.475156:0:22764:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790391792.475176:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e5280031800/0x2b1b7949f13e2cde lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e2ce5 expref: -99 pid: 25100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391792.475183:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5280031800/0x2b1b7949f13e2cde lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e2ce5 expref: -99 pid: 25100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391792.475197:0:22764:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790391792.475200:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d000/0x2b1b7949f13e2b64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e2b6b expref: -99 pid: 24279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391792.475206:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52bab9d000 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:0.0:1790391792.475208:0:22764:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d000/0x2b1b7949f13e2b64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e2b6b expref: -99 pid: 24279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391792.475225:0:22764:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d000/0x2b1b7949f13e2b64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e2b6b expref: -99 pid: 24279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790391792.475231:0:22764:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d000/0x2b1b7949f13e2b64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e2b6b expref: -99 pid: 24279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391792.475236:0:22764:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1790391792.475580:0:25804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288346680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25804:1877361186583296:0@lo:104: 00000100:00100000:2.0:1790391792.475593:0:25804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf948000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25804:1877361186583424:0@lo:104: 00000100:00100000:2.0:1790391792.475600:0:25804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf949f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25804:1877361186583552:0@lo:104: 00000100:00100000:2.0:1790391792.475606:0:25804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831bb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25804:1877361186583680:0@lo:104: 00010000:00010000:1.0:1790391792.475659:0:24815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790391792.475665:0:24815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e52bab9ce00/0x2b1b7949f13e2b25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e2b2c expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391792.475681:0:24815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52bab9ce00 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:1.0:1790391792.475691:0:24815:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e52bab9ce00/0x2b1b7949f13e2b25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e2b2c expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391792.475699:0:24815:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e52bab9ce00/0x2b1b7949f13e2b25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e2b2c expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391792.475706:0:24815:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e52bab9ce00/0x2b1b7949f13e2b25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e2b2c expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391792.475712:0:24815:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790391792.475728:0:24815:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e52bab9ce00/0x2b1b7949f13e2b25 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e2b2c expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391792.475733:0:24815:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790391792.475758:0:24815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e52bab9ce00/0x2b1b7949f13e2b25 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e2b2c expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391792.475764:0:24815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e52bab9ce00/0x2b1b7949f13e2b25 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e2b2c expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391792.475774:0:24815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391792.475777:0:24815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c800/0x2b1b7949f13e2b17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e2b1e expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391792.475784:0:24815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52bab9c800 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:1.0:1790391792.475787:0:24815:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c800/0x2b1b7949f13e2b17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e2b1e expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391792.475794:0:24815:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c800/0x2b1b7949f13e2b17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e2b1e expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391792.475809:0:24815:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c800/0x2b1b7949f13e2b17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e2b1e expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391792.475814:0:24815:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790391792.475827:0:24815:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c800/0x2b1b7949f13e2b17 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e2b1e expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391792.475833:0:24815:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790391792.475839:0:24815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c800/0x2b1b7949f13e2b17 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e2b1e expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391792.475847:0:24815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c800/0x2b1b7949f13e2b17 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e2b1e expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391792.475856:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391792.475858:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391792.475859:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391792.475912:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183babb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e907dcd1-fffe-43bb-853f-376b925bb229:3640:1877361186583808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790391792.475953:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391792.475999:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186583808 00000100:00100000:1.0:1790391792.476004:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186583808 00010000:00010000:1.0:1790391792.476027:0:22762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5184054000/0x2b1b7949f13e2ce5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e2cde expref: 24 pid: 22769 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391792.476053:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790391792.476060:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e907dcd1-fffe-43bb-853f-376b925bb229+24:3640:x1877361186583808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790391792.476070:0:22762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391792.476075:0:22762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5184054000/0x2b1b7949f13e2ce5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e2cde expref: 24 pid: 22769 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391792.476090:0:22762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5184054000/0x2b1b7949f13e2ce5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e2cde expref: 24 pid: 22769 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391792.476105:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5184054000/0x2b1b7949f13e2ce5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e2cde expref: 24 pid: 22769 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391792.476118:0:22762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391792.476146:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e907dcd1-fffe-43bb-853f-376b925bb229+23:3640:x1877361186583808:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391792.476152:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1790391792.476173:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391792.476190:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183babb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e907dcd1-fffe-43bb-853f-376b925bb229:3640:1877361186583808:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790391792.476355:0:22764:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d000/0x2b1b7949f13e2b64 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e2b6b expref: -99 pid: 24279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391792.476362:0:22764:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790391792.476379:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d000/0x2b1b7949f13e2b64 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e2b6b expref: -99 pid: 24279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391792.476386:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d000/0x2b1b7949f13e2b64 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e2b6b expref: -99 pid: 24279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391792.476400:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391792.476402:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391792.476404:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391792.476414:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e907dcd1-fffe-43bb-853f-376b925bb229:3639:1877361186584192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790391792.476441:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391792.476473:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186584192 00000100:00100000:0.0:1790391792.476477:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186584192 00010000:00010000:0.0:1790391792.476492:0:22763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5184055c00/0x2b1b7949f13e2b6b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e2b64 expref: 23 pid: 22770 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391792.476508:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790391792.476514:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183babb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e907dcd1-fffe-43bb-853f-376b925bb229+23:3639:x1877361186584192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790391792.476529:0:22763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391792.476533:0:22763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5184055c00/0x2b1b7949f13e2b6b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e2b64 expref: 23 pid: 22770 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391792.476541:0:22763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5184055c00/0x2b1b7949f13e2b6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e2b64 expref: 23 pid: 22770 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391792.476550:0:22763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5184055c00/0x2b1b7949f13e2b6b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e2b64 expref: 23 pid: 22770 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391792.476559:0:22763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391792.476585:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183babb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e907dcd1-fffe-43bb-853f-376b925bb229+22:3639:x1877361186584192:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391792.476590:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790391792.476613:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e907dcd1-fffe-43bb-853f-376b925bb229:3639:1877361186584192:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790391792.476692:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e907dcd1-fffe-43bb-853f-376b925bb229:3638:1877361186584064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790391792.476719:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391792.476749:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790391792.476755:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e907dcd1-fffe-43bb-853f-376b925bb229:3638:1877361186583936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790391792.476774:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391792.477155:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186584064 00000100:00100000:0.0:1790391792.477160:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186584064 00010000:00010000:0.0:1790391792.477177:0:22761:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5295144400/0x2b1b7949f13e2b1e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e2b17 expref: 22 pid: 22771 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391792.477191:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186583936 00000100:00100000:0.0:1790391792.477193:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186583936 00010000:00010000:0.0:1790391792.477202:0:22761:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5295145600/0x2b1b7949f13e2b2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e2b25 expref: 23 pid: 22771 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391792.477213:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790391792.477868:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e907dcd1-fffe-43bb-853f-376b925bb229+23:3638:x1877361186584064:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790391792.478055:0:22762:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1790391792.478066:0:22762:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1790391792.478452:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391792.478472:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00010000:00010000:0.0:1790391792.478636:0:22761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391792.478645:0:22761:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5295144400/0x2b1b7949f13e2b1e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e2b17 expref: 23 pid: 22771 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391792.478664:0:22761:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5295144400/0x2b1b7949f13e2b1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e2b17 expref: 23 pid: 22771 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391792.478690:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5295144400/0x2b1b7949f13e2b1e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e2b17 expref: 23 pid: 22771 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391792.478703:0:22761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391792.478756:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e907dcd1-fffe-43bb-853f-376b925bb229+22:3638:x1877361186584064:12345-0@lo:103:ldlm_bl.0 Request processed in 1536us (2035us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391792.478765:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790391792.478785:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169686912 00000100:00100000:0.0:1790391792.478791:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169686912 00010000:00010000:0.0:1790391792.478808:0:22761:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e52a7efa400/0x2b1b7949f13e2e90 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0751 expref: 13 pid: 22769 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391792.478822:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169687040 00000100:00100000:0.0:1790391792.478825:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169687040 00010000:00010000:0.0:1790391792.478834:0:22761:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e52bab9d600/0x2b1b7949f13e2e51 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b06e1 expref: 14 pid: 22770 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391792.478844:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790391792.478849:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e907dcd1-fffe-43bb-853f-376b925bb229+21:3638:x1877361186583936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790391792.478856:0:22761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391792.478860:0:22761:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5295145600/0x2b1b7949f13e2b2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e2b25 expref: 21 pid: 22771 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391792.478867:0:22761:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5295145600/0x2b1b7949f13e2b2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e2b25 expref: 21 pid: 22771 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391792.479041:0:25804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288344000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25804:1877361186583040:192.168.202.28@tcp:104: 00000100:00100000:3.0:1790391792.479053:0:25804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288345880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25804:1877361186583168:192.168.202.28@tcp:104: 00000100:00100000:1.0:1790391792.479156:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e907dcd1-fffe-43bb-853f-376b925bb229:3638:1877361186584064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790391792.479661:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 13 00000100:00100000:1.0:1790391792.479680:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87c34307-e556-4f71-950f-f0a41a7cdef6+14:2383:x1877361169686912:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391792.479692:0:22762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391792.479698:0:22762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e52a7efa400/0x2b1b7949f13e2e90 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0751 expref: 14 pid: 22769 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391792.479814:0:25806:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1790391792.479823:0:25806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:3.0:1790391792.480781:0:25804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e52a7efbc00/0x2b1b7949f13e2ec1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391792.482459:0:22763:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1790391792.482488:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 14 00000100:00100000:2.0:1790391792.482503:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183829880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:87c34307-e556-4f71-950f-f0a41a7cdef6+14:2383:x1877361169687040:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391792.482522:0:22763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391792.482531:0:22763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e52bab9d600/0x2b1b7949f13e2e51 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b06e1 expref: 14 pid: 22770 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391792.482564:0:22763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e52bab9d600/0x2b1b7949f13e2e51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b06e1 expref: 14 pid: 22770 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391792.482582:0:22763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52bab9d600/0x2b1b7949f13e2e51 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b06e1 expref: 14 pid: 22770 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391792.482600:0:22763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391792.482679:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183829880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:87c34307-e556-4f71-950f-f0a41a7cdef6+13:2383:x1877361169687040:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 173us (4197us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391792.482687:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 14 00010000:00010000:0.0:1790391792.483611:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5295145600/0x2b1b7949f13e2b2c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e2b25 expref: 21 pid: 22771 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391792.483629:0:22761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391792.483703:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e907dcd1-fffe-43bb-853f-376b925bb229+20:3638:x1877361186583936:12345-0@lo:103:ldlm_bl.0 Request processed in 4851us (6926us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391792.483712:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790391792.483794:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e907dcd1-fffe-43bb-853f-376b925bb229:3638:1877361186583936:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790391792.484297:0:22762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e52a7efa400/0x2b1b7949f13e2e90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0751 expref: 12 pid: 22769 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391792.484310:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52a7efa400/0x2b1b7949f13e2e90 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0751 expref: 12 pid: 22769 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391792.484335:0:22762:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e52a7efbc00/0x2b1b7949f13e2ec1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391792.484343:0:22762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52a7efbc00/0x2b1b7949f13e2ec1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391792.484358:0:22762:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e52a7efbc00/0x2b1b7949f13e2ec1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391792.484364:0:22762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e52a7efbc00/0x2b1b7949f13e2ec1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391792.484370:0:22762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e52a7efbc00/0x2b1b7949f13e2ec1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391792.484377:0:22762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e52a7efbc00/0x2b1b7949f13e2ec1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391792.484383:0:22762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52a7efbc00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:1.0:1790391792.484387:0:22762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e52a7efbc00/0x2b1b7949f13e2ec1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391792.484396:0:22762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e52a7efbc00/0x2b1b7949f13e2ec1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391792.484414:0:22762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e52a7efbc00/0x2b1b7949f13e2ec1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391792.484426:0:22762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391792.484504:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87c34307-e556-4f71-950f-f0a41a7cdef6+11:2383:x1877361169686912:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 4834us (6054us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391792.484519:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 13 00010000:00010000:3.0:1790391792.484606:0:25804:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e52a7efbc00/0x2b1b7949f13e2ec1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391792.484615:0:25804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e52a7efbc00/0x2b1b7949f13e2ec1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391792.484621:0:25804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52a7efbc00/0x2b1b7949f13e2ec1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391792.648414:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790391792.648437:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186584320:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790391792.648507:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391792.648554:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186584320 00000100:00100000:0.0:1790391792.648562:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186584320 00000100:00100000:0.0:1790391792.648601:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790391792.648609:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183babb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186584320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790391792.648803:0:22782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790391792.650383:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183babb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186584320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1767us (1870us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391792.650397:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790391792.663503:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186584320:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790391793.160120:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790391793.161661:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186584448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790391793.161768:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391793.161906:0:24288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186584448 00000100:00100000:1.0:1790391793.161915:0:24288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186584448 00000100:00100000:1.0:1790391793.161987:0:24288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790391793.161997:0:24288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186584448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790391793.162021:0:24288:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1790391793.162075:0:24288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186584448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391793.162082:0:24288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790391793.162212:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186584448:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790391793.162447:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1790391793.352568:0:23532:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790391793.484539:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391793.553633:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391793.553771:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169687168 00000100:00100000:2.0:1790391793.553782:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169687168 00000100:00100000:2.0:1790391793.553855:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 148 00000100:00100000:2.0:1790391793.553867:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87c34307-e556-4f71-950f-f0a41a7cdef6+11:18090:x1877361169687168:12345-192.168.202.28@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790391793.553919:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391793.553941:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52a7efb200/0x2b1b7949f13e2ec8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0789 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391793.553968:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52a7efb200/0x2b1b7949f13e2ec8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0789 expref: 12 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391793.553978:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52a7efb200/0x2b1b7949f13e2ec8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0789 expref: 12 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391793.554004:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52a7efb200, rc 0) 00000100:00100000:2.0:1790391793.554067:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87c34307-e556-4f71-950f-f0a41a7cdef6+12:18090:x1877361169687168:12345-192.168.202.28@tcp:101:ll_cfg_requeue.0 Request processed in 202us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391793.554074:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 148 00000100:00100000:2.0:1790391793.576752:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391793.576852:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169687296 00000100:00100000:0.0:1790391793.576863:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169687296 00000100:00100000:0.0:1790391793.576953:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 149 00000100:00100000:0.0:1790391793.576978:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87c34307-e556-4f71-950f-f0a41a7cdef6+12:18090:x1877361169687296:12345-192.168.202.28@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391793.577148:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87c34307-e556-4f71-950f-f0a41a7cdef6+12:18090:x1877361169687296:12345-192.168.202.28@tcp:501:ll_cfg_requeue.0 Request processed in 163us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391793.577158:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 149 00000100:00100000:3.0:1790391793.589115:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391793.589281:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169687424 00000100:00100000:0.0:1790391793.589291:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169687424 00000100:00100000:0.0:1790391793.589441:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 150 00000100:00100000:0.0:1790391793.589452:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87c34307-e556-4f71-950f-f0a41a7cdef6+12:18090:x1877361169687424:12345-192.168.202.28@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790391793.589604:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87c34307-e556-4f71-950f-f0a41a7cdef6+12:18090:x1877361169687424:12345-192.168.202.28@tcp:503:ll_cfg_requeue.0 Request processed in 152us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391793.589611:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 150 00000100:00100000:1.0:1790391793.594227:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391793.594339:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169687552 00000100:00100000:2.0:1790391793.594350:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169687552 00000100:00100000:2.0:1790391793.594410:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 151 00000100:00100000:2.0:1790391793.594420:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87c34307-e556-4f71-950f-f0a41a7cdef6+12:18090:x1877361169687552:12345-192.168.202.28@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790391793.594437:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391793.594455:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52a7efa800/0x2b1b7949f13e2ecf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0790 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391793.594485:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52a7efa800/0x2b1b7949f13e2ecf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0790 expref: 13 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391793.594497:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52a7efa800/0x2b1b7949f13e2ecf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0790 expref: 13 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391793.594506:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52a7efa800, rc 0) 00000100:00100000:2.0:1790391793.594565:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87c34307-e556-4f71-950f-f0a41a7cdef6+13:18090:x1877361169687552:12345-192.168.202.28@tcp:101:ll_cfg_requeue.0 Request processed in 146us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391793.594573:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 151 00000100:00100000:1.0:1790391793.596546:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391793.596607:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169687680 00000100:00100000:2.0:1790391793.596615:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169687680 00000100:00100000:2.0:1790391793.596671:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 152 00000100:00100000:2.0:1790391793.596694:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87c34307-e556-4f71-950f-f0a41a7cdef6+13:18090:x1877361169687680:12345-192.168.202.28@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790391793.596840:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87c34307-e556-4f71-950f-f0a41a7cdef6+13:18090:x1877361169687680:12345-192.168.202.28@tcp:501:ll_cfg_requeue.0 Request processed in 147us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391793.596848:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 152 00000100:00100000:3.0:1790391793.599669:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391793.599771:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169687808 00000100:00100000:0.0:1790391793.599782:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169687808 00000100:00100000:0.0:1790391793.599837:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 153 00000100:00100000:0.0:1790391793.599847:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87c34307-e556-4f71-950f-f0a41a7cdef6+13:18090:x1877361169687808:12345-192.168.202.28@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790391793.600018:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87c34307-e556-4f71-950f-f0a41a7cdef6+13:18090:x1877361169687808:12345-192.168.202.28@tcp:503:ll_cfg_requeue.0 Request processed in 172us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391793.600026:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 153 00000100:00100000:1.0:1790391793.672840:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186584832:0@lo:400:kworker.0 00000100:00100000:1.0:1790391793.672926:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391793.672953:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183829f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186585344:0@lo:400:kworker.0 00000100:00100000:1.0:1790391793.672970:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391793.672983:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1877361186585856:0@lo:400:kworker.0 00000100:00100000:1.0:1790391793.673001:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391793.673021:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1790391793.673025:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e907dcd1-fffe-43bb-853f-376b925bb229:3640:1877361186584704:0@lo:400:kworker.0 00000100:00100000:1.0:1790391793.673047:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391793.673067:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877361186585216:0@lo:400:kworker.0 00000100:00100000:1.0:1790391793.673084:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391793.673096:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877361186585728:0@lo:400:kworker.0 00000100:00100000:1.0:1790391793.673127:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391793.673656:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186584832 00000100:00100000:2.0:1790391793.673677:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186584832 00000100:00100000:2.0:1790391793.673713:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186585344 00000100:00100000:2.0:1790391793.673715:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186585344 00000100:00100000:2.0:1790391793.673731:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790391793.673739:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186584832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391793.673801:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186584832:12345-0@lo:400:kworker.0 Request processed in 62us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391793.673808:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790391793.673825:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790391793.673829:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186585344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391793.673850:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186585344:12345-0@lo:400:kworker.0 Request processed in 21us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391793.673856:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790391793.673913:0:23840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186585856 00000100:00100000:2.0:1790391793.673917:0:23840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186585856 00000100:00100000:2.0:1790391793.673945:0:23840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186585216 00000100:00100000:2.0:1790391793.673947:0:23840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186585216 00000100:00100000:2.0:1790391793.673956:0:23840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186585728 00000100:00100000:2.0:1790391793.673959:0:23840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186585728 00000100:00100000:2.0:1790391793.673970:0:23840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790391793.673976:0:23840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877361186585856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391793.674002:0:23840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877361186585856:12345-0@lo:400:kworker.0 Request processed in 26us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391793.674016:0:23840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790391793.674026:0:23840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790391793.674030:0:23840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877361186585216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391793.674053:0:23840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877361186585216:12345-0@lo:400:kworker.0 Request processed in 23us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391793.674059:0:23840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790391793.674067:0:23840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790391793.674071:0:23840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877361186585728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391793.674090:0:23840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877361186585728:12345-0@lo:400:kworker.0 Request processed in 19us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391793.674095:0:23840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1790391793.674112:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790391793.674485:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790391793.674498:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186586368:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790391793.674535:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391793.674568:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186584704 00000100:00100000:0.0:1790391793.674572:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186584704 00000100:00100000:0.0:1790391793.674598:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1790391793.674604:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+20:3640:x1877361186584704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391793.674641:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+20:3640:x1877361186584704:12345-0@lo:400:kworker.0 Request processed in 37us (1593us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391793.674647:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1790391793.675091:0:24288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186586368 00000100:00100000:0.0:1790391793.675097:0:24288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186586368 00000100:00100000:0.0:1790391793.675133:0:24288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790391793.679055:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877361186585728:0@lo:400:kworker.0 00000100:00100000:1.0:1790391793.679073:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1877361186586240:0@lo:400:kworker.0 00000100:00100000:1.0:1790391793.679206:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391793.679388:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186584832:0@lo:400:kworker.0 00000100:00100000:1.0:1790391793.679402:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183829f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186585344:0@lo:400:kworker.0 00000100:00100000:1.0:1790391793.679414:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1877361186585856:0@lo:400:kworker.0 00000100:00100000:1.0:1790391793.679446:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e907dcd1-fffe-43bb-853f-376b925bb229:3640:1877361186584704:0@lo:400:kworker.0 00000100:00100000:1.0:1790391793.679459:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877361186585216:0@lo:400:kworker.0 00000100:00100000:1.0:1790391793.679495:0:23840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186586240 00000100:00100000:1.0:1790391793.679502:0:23840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186586240 00000100:00100000:1.0:1790391793.679554:0:23840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790391793.679562:0:23840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877361186586240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391793.679614:0:23840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877361186586240:12345-0@lo:400:kworker.0 Request processed in 52us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391793.679620:0:23840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1790391793.679654:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518382aa00 x1877361186586240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391793.679676:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1877361186586240:0@lo:400:kworker.0 00000100:00080000:2.0:1790391793.679803:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790391793.679809:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790391793.681285:0:24288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518331c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186586368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790391793.681440:0:24288:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790391793.681528:0:24288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518331c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186586368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 262us (6991us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391793.681537:0:24288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790391793.681696:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186584960:0@lo:400:kworker.0 00000100:00100000:3.0:1790391793.681740:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391793.681779:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186585472:0@lo:400:kworker.0 00000100:00100000:3.0:1790391793.681801:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391793.681818:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1877361186585984:0@lo:400:kworker.0 00000100:00100000:3.0:1790391793.681843:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391793.681869:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1790391793.681906:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186584576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790391793.681929:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391793.681943:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186585088:0@lo:400:kworker.0 00000100:00100000:3.0:1790391793.681959:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391793.681994:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186585600:0@lo:400:kworker.0 00000100:00100000:3.0:1790391793.682014:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391793.682029:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183828e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1877361186586112:0@lo:400:kworker.0 00000100:00100000:3.0:1790391793.682052:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391793.682084:0:24286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186584960 00000100:00100000:3.0:1790391793.682090:0:24286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186584960 00000100:00100000:3.0:1790391793.682120:0:24286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186585472 00000100:00100000:3.0:1790391793.682123:0:24286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186585472 00000100:00100000:3.0:1790391793.682135:0:24286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186585088 00000100:00100000:3.0:1790391793.682149:0:24286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186585088 00000100:00100000:3.0:1790391793.682170:0:24286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186585600 00000100:00100000:3.0:1790391793.682172:0:24286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186585600 00000100:00100000:3.0:1790391793.682185:0:24286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790391793.682191:0:24286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186584960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391793.682229:0:24286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186584960:12345-0@lo:400:kworker.0 Request processed in 38us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391793.682235:0:24286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790391793.682260:0:24286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790391793.682266:0:24286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186585472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391793.682291:0:24286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186585472:12345-0@lo:400:kworker.0 Request processed in 25us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391793.682412:0:24286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790391793.682425:0:24286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790391793.682430:0:24286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186585088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391793.682458:0:24286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186585088:12345-0@lo:400:kworker.0 Request processed in 28us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391793.682463:0:24286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790391793.682481:0:24286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790391793.682487:0:24286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186585600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391793.682515:0:24286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186585600:12345-0@lo:400:kworker.0 Request processed in 28us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391793.682520:0:24286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790391793.682542:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186585984 00000100:00100000:3.0:1790391793.682546:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186585984 00000100:00100000:3.0:1790391793.682570:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186586112 00000100:00100000:3.0:1790391793.682573:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186586112 00000100:00100000:3.0:1790391793.682590:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790391793.682596:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877361186585984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391793.682624:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877361186585984:12345-0@lo:400:kworker.0 Request processed in 29us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391793.682630:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790391793.682640:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790391793.682646:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1877361186586112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391793.682682:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1877361186586112:12345-0@lo:400:kworker.0 Request processed in 36us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391793.682688:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790391793.682840:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186585088:0@lo:400:kworker.0 00000100:00100000:3.0:1790391793.682851:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186585600:0@lo:400:kworker.0 00000100:00100000:3.0:1790391793.682859:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183828e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1877361186586112:0@lo:400:kworker.0 00000100:00100000:3.0:1790391793.682868:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186584960:0@lo:400:kworker.0 00000100:00100000:3.0:1790391793.682901:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186585472:0@lo:400:kworker.0 00010000:00080000:3.0:1790391793.682924:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183829500 x1877361186585984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391793.682934:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1877361186585984:0@lo:400:kworker.0 00000100:00080000:2.0:1790391793.683491:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790391793.683496:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790391793.683499:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790391793.683533:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186586368:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790391793.684268:0:24288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186584576 00000100:00100000:0.0:1790391793.684275:0:24288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186584576 00000100:00100000:0.0:1790391793.684334:0:24288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790391793.684343:0:24288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186584576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790391793.684362:0:24288:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790391793.684437:0:24288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186584576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (2505us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391793.684443:0:24288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790391793.684698:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186584576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790391793.713189:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391793.713566:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169687936 00000100:00100000:3.0:1790391793.713578:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169687936 00000100:00100000:3.0:1790391793.713658:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 23 00000100:00100000:3.0:1790391793.713679:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+6:18713:x1877361169687936:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790391793.713700:0:22777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391793.713772:0:22777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d800/0x2b1b7949f13e2ed6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0797 expref: -99 pid: 22777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.713839:0:22777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ca00/0x2b1b7949f13e2edd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.713858:0:22777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ca00/0x2b1b7949f13e2edd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.713872:0:22777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ca00/0x2b1b7949f13e2edd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1790391793.713960:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790391793.714011:0:22777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e2ee4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.714019:0:22777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e2ee4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.714027:0:22777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e2ee4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.714121:0:22777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d600/0x2b1b7949f13e2eeb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.714130:0:22777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d600/0x2b1b7949f13e2eeb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.714137:0:22777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d600/0x2b1b7949f13e2eeb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391793.714167:0:22777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790391793.714171:0:22777:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790391793.714531:0:22777:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d600/0x2b1b7949f13e2eeb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.714543:0:22777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ca00/0x2b1b7949f13e2edd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.714549:0:22777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ca00/0x2b1b7949f13e2edd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.714556:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ca00/0x2b1b7949f13e2edd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.714562:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52bab9ca00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391793.714566:0:22777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ca00/0x2b1b7949f13e2edd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.714573:0:22777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ca00/0x2b1b7949f13e2edd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.714583:0:22777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e52b9b70200) 00010000:00010000:3.0:1790391793.714593:0:22777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391793.714598:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ca00/0x2b1b7949f13e2edd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.714604:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ca00/0x2b1b7949f13e2edd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.714617:0:22777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e2ee4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.714622:0:22777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e2ee4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.714627:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e2ee4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.714632:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52bab9de00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391793.714635:0:22777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e2ee4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.714641:0:22777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e2ee4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.714648:0:22777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9e51821bad00) 00010000:00010000:3.0:1790391793.714650:0:22777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391793.714653:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e2ee4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.714658:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e2ee4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.714702:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d800/0x2b1b7949f13e2ed6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0797 expref: 8 pid: 22777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.714727:0:22777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d600/0x2b1b7949f13e2eeb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0797 expref: 7 pid: 22777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.714734:0:22777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e51821ba200) 00010000:00010000:3.0:1790391793.714736:0:22777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790391793.714738:0:22777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52bab9d600, rc 0) 00000100:00100000:3.0:1790391793.714806:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+7:18713:x1877361169687936:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 1129us (1627us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391793.714814:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 23 00000100:00100000:1.0:1790391793.719644:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391793.719752:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169688064 00000100:00100000:2.0:1790391793.719762:0:22787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169688064 00000100:00100000:2.0:1790391793.719818:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 5 00000100:00100000:2.0:1790391793.719829:0:22787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c67287cd-8d89-444e-807d-10aa5015d6e5+7:18713:x1877361169688064:12345-192.168.202.28@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1790391793.719934:0:22787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c67287cd-8d89-444e-807d-10aa5015d6e5+7:18713:x1877361169688064:12345-192.168.202.28@tcp:900:lhsmtool_posix.0 Request processed in 107us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391793.719941:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 5 00000100:00100000:2.0:1790391793.726429:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391793.726517:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169688320 00000100:00100000:1.0:1790391793.726527:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169688320 00000100:00100000:1.0:1790391793.726581:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 24 00000100:00100000:1.0:1790391793.726590:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+7:18713:x1877361169688320:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790391793.726610:0:22776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391793.726629:0:22776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055e00/0x2b1b7949f13e2ef2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b079e expref: -99 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391793.726711:0:22776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055c00/0x2b1b7949f13e2ef9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391793.726726:0:22776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055c00/0x2b1b7949f13e2ef9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391793.726738:0:22776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055c00/0x2b1b7949f13e2ef9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391793.726775:0:22776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054000/0x2b1b7949f13e2f00 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391793.726783:0:22776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054000/0x2b1b7949f13e2f00 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391793.726790:0:22776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054000/0x2b1b7949f13e2f00 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391793.726928:0:22776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054600/0x2b1b7949f13e2f07 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391793.726937:0:22776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054600/0x2b1b7949f13e2f07 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391793.726960:0:22776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054600/0x2b1b7949f13e2f07 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391793.726969:0:22776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1790391793.727113:0:22776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055c00/0x2b1b7949f13e2ef9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391793.727121:0:22776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055c00/0x2b1b7949f13e2ef9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391793.727127:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055c00/0x2b1b7949f13e2ef9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391793.727132:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5184055c00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:1.0:1790391793.727137:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055c00/0x2b1b7949f13e2ef9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391793.727145:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055c00/0x2b1b7949f13e2ef9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391793.727157:0:22776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e51821ba200) 00010000:00010000:1.0:1790391793.727160:0:22776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391793.727165:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055c00/0x2b1b7949f13e2ef9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391793.727171:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055c00/0x2b1b7949f13e2ef9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391793.727185:0:22776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054000/0x2b1b7949f13e2f00 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391793.727191:0:22776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054000/0x2b1b7949f13e2f00 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391793.727203:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054000/0x2b1b7949f13e2f00 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391793.727208:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5184054000 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:1.0:1790391793.727210:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054000/0x2b1b7949f13e2f00 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391793.727217:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054000/0x2b1b7949f13e2f00 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391793.727225:0:22776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e52832fa200) 00010000:00010000:1.0:1790391793.727227:0:22776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391793.727230:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054000/0x2b1b7949f13e2f00 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391793.727236:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054000/0x2b1b7949f13e2f00 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391793.728773:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055e00/0x2b1b7949f13e2ef2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b079e expref: 10 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391793.728799:0:22776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054600/0x2b1b7949f13e2f07 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b079e expref: 9 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391793.728808:0:22776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e52832fae00) 00010000:00010000:2.0:1790391793.728810:0:22776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391793.728813:0:22776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5184054600, rc 0) 00000100:00100000:2.0:1790391793.728908:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+9:18713:x1877361169688320:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 2317us (2486us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1790391793.728916:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 24 00000100:00100000:1.0:1790391793.731970:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391793.732131:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169688448 00000100:00100000:3.0:1790391793.732151:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169688448 00000100:00100000:3.0:1790391793.732208:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 25 00000100:00100000:3.0:1790391793.732219:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+9:18713:x1877361169688448:12345-192.168.202.28@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1790391793.732340:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+9:18713:x1877361169688448:12345-192.168.202.28@tcp:59:lhsmtool_posix.0 Request processed in 122us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391793.732348:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 25 00000100:00100000:1.0:1790391793.735151:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391793.735250:0:23840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169688576 00000100:00100000:2.0:1790391793.735260:0:23840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169688576 00000100:00100000:2.0:1790391793.735398:0:23840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 26 00000100:00100000:2.0:1790391793.735409:0:23840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c67287cd-8d89-444e-807d-10aa5015d6e5+5:18713:x1877361169688576:12345-192.168.202.28@tcp:59:lhsmtool_posix.0 00000004:00080000:1.0:1790391793.741731:0:23840:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 6277us 00000100:00080000:0.0:1790391793.749410:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790391793.783687:0:23840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c67287cd-8d89-444e-807d-10aa5015d6e5+5:18713:x1877361169688576:12345-192.168.202.28@tcp:59:lhsmtool_posix.0 Request processed in 48270us (48540us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391793.783701:0:23840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 26 00000100:00100000:2.0:1790391793.821646:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391793.821774:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169688704 00000100:00100000:3.0:1790391793.821785:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169688704 00000100:00100000:3.0:1790391793.821931:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 27 00000100:00100000:3.0:1790391793.821941:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+9:18719:x1877361169688704:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:3.0:1790391793.821962:0:22777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391793.821983:0:22777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d800/0x2b1b7949f13e2f15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b07a5 expref: -99 pid: 22777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.822043:0:22777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e2f1c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.822073:0:22777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e2f1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.822085:0:22777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e2f1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.822162:0:22777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ca00/0x2b1b7949f13e2f23 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.822170:0:22777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ca00/0x2b1b7949f13e2f23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.822177:0:22777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ca00/0x2b1b7949f13e2f23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.822218:0:22777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e2f1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.822225:0:22777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e2f1c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.822232:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e2f1c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.822238:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52bab9de00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391793.822252:0:22777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e2f1c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.822259:0:22777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e2f1c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.822272:0:22777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e52b9b70200) 00010000:00010000:3.0:1790391793.822281:0:22777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391793.822286:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e2f1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.822504:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e2f1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.822523:0:22777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ca00/0x2b1b7949f13e2f23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.822528:0:22777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ca00/0x2b1b7949f13e2f23 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.822533:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ca00/0x2b1b7949f13e2f23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.822538:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52bab9ca00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391793.822540:0:22777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ca00/0x2b1b7949f13e2f23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.822546:0:22777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ca00/0x2b1b7949f13e2f23 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.822554:0:22777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9e51821bad00) 00010000:00010000:3.0:1790391793.822557:0:22777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391793.822560:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ca00/0x2b1b7949f13e2f23 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.822564:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ca00/0x2b1b7949f13e2f23 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.822598:0:22777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d800/0x2b1b7949f13e2f15 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b07a5 expref: 10 pid: 22777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.822614:0:22777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e52b9b70200) 00010000:00010000:3.0:1790391793.822617:0:22777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391793.822621:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d800/0x2b1b7949f13e2f15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b07a5 expref: 10 pid: 22777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.822631:0:22777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52bab9d800, rc 0) 00000100:00100000:3.0:1790391793.822756:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+9:18719:x1877361169688704:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 815us (1121us total) trans 0 rc 301/301 00000100:00100000:3.0:1790391793.822764:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 27 00000100:00100000:0.0:1790391793.827649:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391793.827801:0:22785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169688832 00000100:00100000:2.0:1790391793.827810:0:22785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169688832 00000100:00100000:2.0:1790391793.827863:0:22785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 0 00000100:00100000:2.0:1790391793.827874:0:22785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c67287cd-8d89-444e-807d-10aa5015d6e5+9:18719:x1877361169688832:12345-192.168.202.28@tcp:700:lfs.0 00000100:00100000:2.0:1790391793.827988:0:22785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c67287cd-8d89-444e-807d-10aa5015d6e5+9:18719:x1877361169688832:12345-192.168.202.28@tcp:700:lfs.0 Request processed in 115us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391793.827996:0:22785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 0 00000100:00100000:2.0:1790391793.830106:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391793.830425:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169689088 00000100:00100000:1.0:1790391793.830435:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169689088 00000100:00100000:1.0:1790391793.830531:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 28 00000100:00100000:1.0:1790391793.830541:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+9:18719:x1877361169689088:12345-192.168.202.28@tcp:36:lfs.0 00010000:00010000:1.0:1790391793.830594:0:22776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391793.830621:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d400/0x2b1b7949f13e2e7b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0712 expref: 9 pid: 22777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391793.830668:0:22776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e52b9b70200) 00010000:00010000:1.0:1790391793.830674:0:22776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790391793.830739:0:22776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763cc00/0x2b1b7949f13e2f2a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391793.830753:0:22776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055a00/0x2b1b7949f13e2eba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0782 expref: 5 pid: 23840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391793.830761:0:22776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763cc00/0x2b1b7949f13e2f2a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391793.830791:0:22776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055a00/0x2b1b7949f13e2eba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0782 expref: 5 pid: 23840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391793.830804:0:22776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055a00/0x2b1b7949f13e2eba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0782 expref: 5 pid: 23840 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391793.830820:0:22776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183828000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22776:1877361186586496:192.168.202.28@tcp:104: 00000100:00100000:1.0:1790391793.831023:0:22776:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5282bb49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391793.834101:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391793.834175:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169689216 00000100:00100000:2.0:1790391793.834198:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169689216 00010000:00010000:2.0:1790391793.834310:0:22763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055a00/0x2b1b7949f13e2eba lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0782 expref: 6 pid: 23840 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391793.834353:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 15 00000100:00100000:2.0:1790391793.834363:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06a5f5e7-5ead-4721-91c8-25641992d7dd+6:2384:x1877361169689216:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391793.834377:0:22763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391793.834383:0:22763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055a00/0x2b1b7949f13e2eba lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0782 expref: 6 pid: 23840 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391793.834395:0:22763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055a00/0x2b1b7949f13e2eba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0782 expref: 6 pid: 23840 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391793.834416:0:22763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e52b9b70200) 00010000:00010000:2.0:1790391793.834421:0:22763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763cc00/0x2b1b7949f13e2f2a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391793.834430:0:22763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763cc00/0x2b1b7949f13e2f2a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391793.834437:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763cc00/0x2b1b7949f13e2f2a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391793.834454:0:22763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391793.834501:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06a5f5e7-5ead-4721-91c8-25641992d7dd+6:2384:x1877361169689216:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 139us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391793.834509:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 15 00010000:00010000:1.0:1790391793.835836:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055a00/0x2b1b7949f13e2eba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0782 expref: 5 pid: 23840 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391793.835860:0:22776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183828000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22776:1877361186586496:192.168.202.28@tcp:104: 00010000:00010000:1.0:1790391793.835944:0:22776:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763cc00/0x2b1b7949f13e2f2a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391793.835955:0:22776:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763cc00/0x2b1b7949f13e2f2a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391793.835973:0:22776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763cc00/0x2b1b7949f13e2f2a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391793.835995:0:22776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e2f31 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391793.836006:0:22776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e2f31 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391793.836015:0:22776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e2f31 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1790391793.836950:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790391793.838427:0:22776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145c00/0x2b1b7949f13e2f38 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391793.838447:0:22776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145c00/0x2b1b7949f13e2f38 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391793.838460:0:22776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145c00/0x2b1b7949f13e2f38 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790391793.838480:0:22776:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000060fe4594 reply state 0000000025eb0ca3 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145c00/0x2b1b7949f13e2f38 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391793.838491:0:22776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145c00/0x2b1b7949f13e2f38 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391793.838498:0:22776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e5182c83300) 00010000:00010000:0.0:1790391793.838501:0:22776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790391793.838504:0:22776:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1790391793.838510:0:22776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1790391793.838518:0:22776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763cc00/0x2b1b7949f13e2f2a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391793.838525:0:22776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763cc00/0x2b1b7949f13e2f2a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391793.838532:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763cc00/0x2b1b7949f13e2f2a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391793.838537:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763cc00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391793.838541:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763cc00/0x2b1b7949f13e2f2a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391793.838548:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763cc00/0x2b1b7949f13e2f2a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391793.838566:0:22776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e52b9b70200) 00010000:00010000:0.0:1790391793.838568:0:22776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391793.838571:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763cc00/0x2b1b7949f13e2f2a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391793.838577:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763cc00/0x2b1b7949f13e2f2a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790391793.838598:0:22776:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000060fe4594 reply state 0000000025eb0ca3 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e2f31 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391793.838606:0:22776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e2f31 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391793.838611:0:22776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9e52832fa200) 00010000:00010000:0.0:1790391793.838613:0:22776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790391793.838615:0:22776:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1790391793.838773:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+10:18719:x1877361169689088:12345-192.168.202.28@tcp:36:lfs.0 Request processed in 8229us (8670us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1790391793.838783:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 28 00000100:00100000:0.0:1790391793.917491:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391793.917600:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169689344 00000100:00100000:3.0:1790391793.917610:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169689344 00000100:00100000:3.0:1790391793.917680:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 29 00000100:00100000:3.0:1790391793.917690:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c67287cd-8d89-444e-807d-10aa5015d6e5+10:18727:x1877361169689344:12345-192.168.202.28@tcp:101:lctl.0 00010000:00010000:3.0:1790391793.917717:0:22778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391793.917740:0:22778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d800/0x2b1b7949f13e2f3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b07ac expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.917804:0:22778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ca00/0x2b1b7949f13e2f46 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.917820:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ca00/0x2b1b7949f13e2f46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.917833:0:22778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ca00/0x2b1b7949f13e2f46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391793.917914:0:22778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790391793.917932:0:22778:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790391793.917974:0:22778:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ca00/0x2b1b7949f13e2f46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.918000:0:22778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d800/0x2b1b7949f13e2f3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b07ac expref: 12 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.918017:0:22778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ca00/0x2b1b7949f13e2f46 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b07ac expref: 11 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.918026:0:22778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e51821bad00) 00010000:00010000:3.0:1790391793.918029:0:22778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790391793.918032:0:22778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52bab9ca00, rc 0) 00000100:00100000:3.0:1790391793.918095:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c67287cd-8d89-444e-807d-10aa5015d6e5+11:18727:x1877361169689344:12345-192.168.202.28@tcp:101:lctl.0 Request processed in 406us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391793.918102:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 29 00000100:00100000:0.0:1790391793.947378:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391793.947571:0:23840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169689472 00000100:00100000:1.0:1790391793.947582:0:23840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169689472 00000100:00100000:1.0:1790391793.947653:0:23840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 30 00000100:00100000:1.0:1790391793.947674:0:23840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:06a5f5e7-5ead-4721-91c8-25641992d7dd+5:18728:x1877361169689472:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:1.0:1790391793.947696:0:23840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391793.947717:0:23840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e2f4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b07b3 expref: -99 pid: 23840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391793.947792:0:23840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e2f54 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391793.947810:0:23840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e2f54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391793.947823:0:23840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e2f54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391793.947871:0:23840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1790391793.947915:0:23840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790391793.947942:0:23840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e2f54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391793.947969:0:23840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e2f4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b07b3 expref: 7 pid: 23840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391793.947989:0:23840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e2f54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b07b3 expref: 6 pid: 23840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391793.947998:0:23840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e51821bad00) 00010000:00010000:1.0:1790391793.948001:0:23840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790391793.948004:0:23840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b763c000, rc 0) 00000100:00100000:1.0:1790391793.948070:0:23840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:06a5f5e7-5ead-4721-91c8-25641992d7dd+6:18728:x1877361169689472:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 397us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391793.948077:0:23840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 30 00000100:00100000:0.0:1790391793.952323:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391793.952410:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169689600 00000100:00100000:3.0:1790391793.952420:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169689600 00000100:00100000:3.0:1790391793.952478:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 31 00000100:00100000:3.0:1790391793.952488:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06a5f5e7-5ead-4721-91c8-25641992d7dd+6:18728:x1877361169689600:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:3.0:1790391793.952507:0:22778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391793.952525:0:22778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d800/0x2b1b7949f13e2f5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b07ba expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.952584:0:22778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e2f62 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.952597:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e2f62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.952624:0:22778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e2f62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.952636:0:22778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d000/0x2b1b7949f13e2f69 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.952643:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d000/0x2b1b7949f13e2f69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.952650:0:22778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d000/0x2b1b7949f13e2f69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.952738:0:22778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9c800/0x2b1b7949f13e2f70 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.952746:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9c800/0x2b1b7949f13e2f70 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.952754:0:22778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9c800/0x2b1b7949f13e2f70 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391793.952794:0:22778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790391793.952798:0:22778:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790391793.952818:0:22778:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9c800/0x2b1b7949f13e2f70 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.952831:0:22778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e2f62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.952838:0:22778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e2f62 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.952853:0:22778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e2f62 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.952859:0:22778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52bab9de00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391793.952864:0:22778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e2f62 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.952872:0:22778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e2f62 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.952928:0:22778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e51821bad00) 00010000:00010000:3.0:1790391793.952932:0:22778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391793.952936:0:22778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e2f62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.952942:0:22778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e2f62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.952955:0:22778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d000/0x2b1b7949f13e2f69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.952961:0:22778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d000/0x2b1b7949f13e2f69 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.952966:0:22778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d000/0x2b1b7949f13e2f69 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.952971:0:22778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52bab9d000 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391793.952974:0:22778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d000/0x2b1b7949f13e2f69 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.952989:0:22778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d000/0x2b1b7949f13e2f69 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.952997:0:22778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9e52832fa200) 00010000:00010000:3.0:1790391793.953000:0:22778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391793.953003:0:22778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d000/0x2b1b7949f13e2f69 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.953009:0:22778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d000/0x2b1b7949f13e2f69 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.953033:0:22778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d800/0x2b1b7949f13e2f5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b07ba expref: 8 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.953046:0:22778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9c800/0x2b1b7949f13e2f70 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b07ba expref: 7 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.953053:0:22778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e5182c83300) 00010000:00010000:3.0:1790391793.953055:0:22778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790391793.953058:0:22778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52bab9c800, rc 0) 00000100:00100000:3.0:1790391793.953109:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06a5f5e7-5ead-4721-91c8-25641992d7dd+7:18728:x1877361169689600:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 622us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391793.953116:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 31 00000100:00100000:2.0:1790391793.955598:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391793.955691:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169689728 00000100:00100000:3.0:1790391793.955705:0:22787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169689728 00000100:00100000:3.0:1790391793.955782:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 6 00000100:00100000:3.0:1790391793.955793:0:22787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:06a5f5e7-5ead-4721-91c8-25641992d7dd+5:18728:x1877361169689728:12345-192.168.202.28@tcp:900:lfs.0 00000100:00100000:3.0:1790391793.955915:0:22787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:06a5f5e7-5ead-4721-91c8-25641992d7dd+5:18728:x1877361169689728:12345-192.168.202.28@tcp:900:lfs.0 Request processed in 123us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391793.955923:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 6 00000100:00080000:0.0:1790391793.956234:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790391793.960323:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391793.960466:0:23840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169689984 00000100:00100000:1.0:1790391793.960477:0:23840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169689984 00000100:00100000:1.0:1790391793.960536:0:23840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 32 00000100:00100000:1.0:1790391793.960545:0:23840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:06a5f5e7-5ead-4721-91c8-25641992d7dd+7:18728:x1877361169689984:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:1.0:1790391793.960563:0:23840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391793.960583:0:23840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e2f77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b07c1 expref: -99 pid: 23840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391793.960789:0:23840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1790391793.960980:0:23840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e2f77 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b07c1 expref: 9 pid: 23840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391793.960995:0:23840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e51821bad00) 00010000:00010000:1.0:1790391793.961012:0:23840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790391793.961019:0:23840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e2f77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b07c1 expref: 9 pid: 23840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391793.961033:0:23840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b763de00, rc 0) 00000100:00100000:1.0:1790391793.961096:0:23840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:06a5f5e7-5ead-4721-91c8-25641992d7dd+8:18728:x1877361169689984:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 551us (782us total) trans 12884901891 rc 301/301 00000100:00100000:1.0:1790391793.961103:0:23840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 32 00000100:00100000:2.0:1790391793.964407:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391793.964515:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169690240 00000100:00100000:3.0:1790391793.964525:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169690240 00000100:00100000:3.0:1790391793.964585:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 33 00000100:00100000:3.0:1790391793.964596:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06a5f5e7-5ead-4721-91c8-25641992d7dd+8:18728:x1877361169690240:12345-192.168.202.28@tcp:36:lfs.0 00010000:00010000:3.0:1790391793.964670:0:22778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391793.964698:0:22778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9c800/0x2b1b7949f13e2f70 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b07ba expref: 8 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.964717:0:22778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e5182c83300) 00010000:00010000:3.0:1790391793.964723:0:22778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790391793.964747:0:22778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d800/0x2b1b7949f13e2f85 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.964761:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d800/0x2b1b7949f13e2f85 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.964771:0:22778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d800/0x2b1b7949f13e2f85 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790391793.965053:0:22778:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000085ab441 reply state 000000008ae95f18 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d800/0x2b1b7949f13e2f85 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.965068:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d800/0x2b1b7949f13e2f85 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.965075:0:22778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e5182c83300) 00010000:00010000:3.0:1790391793.965085:0:22778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1790391793.965088:0:22778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1790391793.965097:0:22778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1790391793.965192:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06a5f5e7-5ead-4721-91c8-25641992d7dd+9:18728:x1877361169690240:12345-192.168.202.28@tcp:36:lfs.0 Request processed in 597us (795us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1790391793.965200:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 33 00000100:00100000:2.0:1790391793.977096:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391793.977187:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169690496 00000100:00100000:3.0:1790391793.977197:0:22779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169690496 00000100:00100000:3.0:1790391793.977256:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 2 00000100:00100000:3.0:1790391793.977267:0:22779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:06a5f5e7-5ead-4721-91c8-25641992d7dd+9:18728:x1877361169690496:12345-192.168.202.28@tcp:35:lfs.0 00000100:00100000:3.0:1790391793.977507:0:22779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:06a5f5e7-5ead-4721-91c8-25641992d7dd+10:18728:x1877361169690496:12345-192.168.202.28@tcp:35:lfs.0 Request processed in 241us (421us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1790391793.977515:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 2 00000100:00100000:0.0:1790391793.980206:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391793.980980:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169690752 00000100:00100000:2.0:1790391793.980994:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169690752 00000100:00100000:2.0:1790391793.981063:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 34 00000100:00100000:2.0:1790391793.981073:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06a5f5e7-5ead-4721-91c8-25641992d7dd+10:18728:x1877361169690752:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:2.0:1790391793.981097:0:22776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391793.981119:0:22776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efae00/0x2b1b7949f13e2f8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b07c8 expref: -99 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391793.981190:0:22776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e2f93 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391793.981204:0:22776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e2f93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391793.981216:0:22776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e2f93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391793.981227:0:22776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb800/0x2b1b7949f13e2f9a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391793.981234:0:22776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb800/0x2b1b7949f13e2f9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391793.981241:0:22776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb800/0x2b1b7949f13e2f9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391793.981371:0:22776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1790391793.981448:0:22776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e2f93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391793.981456:0:22776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e2f93 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391793.981477:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e2f93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391793.981482:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52a7efa200 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391793.981486:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e2f93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391793.981494:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e2f93 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391793.981506:0:22776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e51821bad00) 00010000:00010000:2.0:1790391793.981508:0:22776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391793.981513:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e2f93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391793.981521:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e2f93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391793.981533:0:22776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb800/0x2b1b7949f13e2f9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391793.981539:0:22776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb800/0x2b1b7949f13e2f9a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391793.981545:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb800/0x2b1b7949f13e2f9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391793.981549:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52a7efb800 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391793.981551:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb800/0x2b1b7949f13e2f9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391793.981565:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb800/0x2b1b7949f13e2f9a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391793.981572:0:22776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9e52832fa200) 00010000:00010000:2.0:1790391793.981574:0:22776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391793.981577:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb800/0x2b1b7949f13e2f9a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391793.981583:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb800/0x2b1b7949f13e2f9a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391793.981613:0:22776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efae00/0x2b1b7949f13e2f8c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b07c8 expref: 12 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391793.981622:0:22776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e51821bad00) 00010000:00010000:2.0:1790391793.981625:0:22776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790391793.981628:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efae00/0x2b1b7949f13e2f8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b07c8 expref: 12 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391793.981649:0:22776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52a7efae00, rc 0) 00000100:00100000:2.0:1790391793.981729:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06a5f5e7-5ead-4721-91c8-25641992d7dd+11:18728:x1877361169690752:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 657us (1533us total) trans 12884901894 rc 301/301 00000100:00100000:2.0:1790391793.981737:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 34 00000100:00100000:2.0:1790391793.984871:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391793.985106:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169690880 00000100:00100000:3.0:1790391793.985118:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169690880 00000100:00100000:3.0:1790391793.985187:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 35 00000100:00100000:3.0:1790391793.985197:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06a5f5e7-5ead-4721-91c8-25641992d7dd+11:18728:x1877361169690880:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:3.0:1790391793.985219:0:22778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391793.985247:0:22778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9c800/0x2b1b7949f13e2fa8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b07cf expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.985350:0:22778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d000/0x2b1b7949f13e2faf lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.985364:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d000/0x2b1b7949f13e2faf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.985376:0:22778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d000/0x2b1b7949f13e2faf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391793.985417:0:22778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790391793.985421:0:22778:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790391793.985441:0:22778:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d000/0x2b1b7949f13e2faf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.985468:0:22778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9c800/0x2b1b7949f13e2fa8 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b07cf expref: 13 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.985486:0:22778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d000/0x2b1b7949f13e2faf lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b07cf expref: 12 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391793.985494:0:22778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e5182c83300) 00010000:00010000:3.0:1790391793.985498:0:22778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790391793.985501:0:22778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52bab9d000, rc 0) 00000100:00100000:3.0:1790391793.985603:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06a5f5e7-5ead-4721-91c8-25641992d7dd+12:18728:x1877361169690880:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 407us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391793.985610:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 35 00000100:00100000:0.0:1790391793.991997:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391793.992167:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169691008 00000100:00100000:3.0:1790391793.992178:0:22779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169691008 00000100:00100000:3.0:1790391793.992245:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 3 00000100:00100000:3.0:1790391793.992256:0:22779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:06a5f5e7-5ead-4721-91c8-25641992d7dd+12:18728:x1877361169691008:12345-192.168.202.28@tcp:37:lfs.0 00000100:00100000:3.0:1790391793.996042:0:22779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:06a5f5e7-5ead-4721-91c8-25641992d7dd+12:18728:x1877361169691008:12345-192.168.202.28@tcp:37:lfs.0 Request processed in 3777us (4045us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391793.996055:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 3 00000100:00100000:2.0:1790391794.002772:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391794.002872:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169691264 00000100:00100000:1.0:1790391794.002911:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169691264 00000100:00100000:1.0:1790391794.002970:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 4 00000100:00100000:1.0:1790391794.002981:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52baa40450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:06a5f5e7-5ead-4721-91c8-25641992d7dd+12:18728:x1877361169691264:12345-192.168.202.28@tcp:35:lfs.0 00000100:00100000:1.0:1790391794.003204:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52baa40450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:06a5f5e7-5ead-4721-91c8-25641992d7dd+13:18728:x1877361169691264:12345-192.168.202.28@tcp:35:lfs.0 Request processed in 223us (441us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1790391794.003211:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 4 00000100:00100000:0.0:1790391794.059548:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391794.059649:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169691392 00000100:00100000:2.0:1790391794.059667:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169691392 00000100:00100000:2.0:1790391794.059734:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 36 00000100:00100000:2.0:1790391794.059758:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+11:18734:x1877361169691392:12345-192.168.202.28@tcp:101:bash.0 00010000:00010000:2.0:1790391794.059788:0:22776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391794.059810:0:22776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb800/0x2b1b7949f13e2fb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b07d6 expref: -99 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.059899:0:22776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e2fbd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.059913:0:22776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e2fbd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.059924:0:22776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e2fbd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.059936:0:22776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb400/0x2b1b7949f13e2fc4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.059942:0:22776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb400/0x2b1b7949f13e2fc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.059947:0:22776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb400/0x2b1b7949f13e2fc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.060007:0:22776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efbe00/0x2b1b7949f13e2fcb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.060012:0:22776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efbe00/0x2b1b7949f13e2fcb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.060017:0:22776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efbe00/0x2b1b7949f13e2fcb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391794.060053:0:22776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790391794.060056:0:22776:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790391794.060112:0:22776:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efbe00/0x2b1b7949f13e2fcb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.060124:0:22776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e2fbd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.060130:0:22776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e2fbd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.060136:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e2fbd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.060142:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52a7efa200 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391794.060147:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e2fbd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.060154:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e2fbd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.060179:0:22776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e51821bad00) 00010000:00010000:2.0:1790391794.060182:0:22776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391794.060187:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e2fbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.060193:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e2fbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.060206:0:22776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb400/0x2b1b7949f13e2fc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.060221:0:22776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb400/0x2b1b7949f13e2fc4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.060227:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb400/0x2b1b7949f13e2fc4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.060231:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52a7efb400 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391794.060234:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb400/0x2b1b7949f13e2fc4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.060240:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb400/0x2b1b7949f13e2fc4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.060249:0:22776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9e52832fa200) 00010000:00010000:2.0:1790391794.060251:0:22776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391794.060254:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb400/0x2b1b7949f13e2fc4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.060260:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb400/0x2b1b7949f13e2fc4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.060287:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb800/0x2b1b7949f13e2fb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b07d6 expref: 13 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.060301:0:22776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efbe00/0x2b1b7949f13e2fcb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b07d6 expref: 12 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.060308:0:22776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e5182c83300) 00010000:00010000:2.0:1790391794.060310:0:22776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1790391794.060319:0:22776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52a7efbe00, rc 0) 00000100:00100000:2.0:1790391794.060384:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+12:18734:x1877361169691392:12345-192.168.202.28@tcp:101:bash.0 Request processed in 628us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391794.060391:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 36 00000100:00100000:0.0:1790391794.062558:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391794.062620:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169691520 00000100:00100000:3.0:1790391794.062631:0:22787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169691520 00000100:00100000:3.0:1790391794.062697:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 7 00000100:00100000:3.0:1790391794.062707:0:22787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c67287cd-8d89-444e-807d-10aa5015d6e5+5:18734:x1877361169691520:12345-192.168.202.28@tcp:900:bash.0 00000100:00100000:3.0:1790391794.062784:0:22787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c67287cd-8d89-444e-807d-10aa5015d6e5+5:18734:x1877361169691520:12345-192.168.202.28@tcp:900:bash.0 Request processed in 78us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391794.062791:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 7 00000100:00100000:0.0:1790391794.065125:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391794.065271:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169691776 00000100:00100000:3.0:1790391794.065281:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169691776 00000100:00100000:3.0:1790391794.065332:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 37 00000100:00100000:3.0:1790391794.065342:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c67287cd-8d89-444e-807d-10aa5015d6e5+12:18734:x1877361169691776:12345-192.168.202.28@tcp:101:bash.0 00010000:00010000:3.0:1790391794.065361:0:22778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391794.065383:0:22778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9c800/0x2b1b7949f13e2fd2 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b07dd expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391794.065486:0:22778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e2fd9 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391794.065501:0:22778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d000/0x2b1b7949f13e2faf lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b07cf expref: 12 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391794.065510:0:22778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e2fd9 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391794.065783:0:22778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d000/0x2b1b7949f13e2faf lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b07cf expref: 12 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391794.065797:0:22778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d000/0x2b1b7949f13e2faf lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b07cf expref: 12 pid: 22778 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391794.065834:0:22778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf948000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22778:1877361186586624:192.168.202.28@tcp:104: 00000100:00100000:3.0:1790391794.065988:0:22778:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e8ba540 going to sleep for 11 seconds 00000100:00100000:0.0:1790391794.070482:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391794.070669:0:22778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf948000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22778:1877361186586624:192.168.202.28@tcp:104: 00010000:00010000:3.0:1790391794.070698:0:22778:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e2fd9 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391794.070985:0:25806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169691904 00000100:00100000:2.0:1790391794.070991:0:25806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169691904 00010000:00010000:2.0:1790391794.071035:0:25806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d000/0x2b1b7949f13e2faf lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b07cf expref: 13 pid: 22778 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391794.071111:0:25806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 16 00000100:00100000:2.0:1790391794.071122:0:25806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:06a5f5e7-5ead-4721-91c8-25641992d7dd+13:2384:x1877361169691904:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391794.071146:0:25806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391794.071153:0:25806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d000/0x2b1b7949f13e2faf lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b07cf expref: 13 pid: 22778 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.071165:0:25806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d000/0x2b1b7949f13e2faf lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b07cf expref: 13 pid: 22778 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.071187:0:25806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d000/0x2b1b7949f13e2faf lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b07cf expref: 13 pid: 22778 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.071202:0:25806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e5182c83300) 00010000:00010000:2.0:1790391794.071207:0:25806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e2fd9 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.071216:0:25806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e2fd9 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.071223:0:25806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e2fd9 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.071280:0:25806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391794.071352:0:25806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:06a5f5e7-5ead-4721-91c8-25641992d7dd+12:2384:x1877361169691904:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 231us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391794.071359:0:25806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 16 00010000:00010000:3.0:1790391794.071410:0:22778:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e2fd9 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391794.071418:0:22778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e2fd9 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391794.071489:0:22778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ce00/0x2b1b7949f13e2fe0 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391794.071499:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ce00/0x2b1b7949f13e2fe0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391794.071506:0:22778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ce00/0x2b1b7949f13e2fe0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391794.072777:0:22778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d400/0x2b1b7949f13e2fe7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391794.072793:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d400/0x2b1b7949f13e2fe7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391794.072803:0:22778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d400/0x2b1b7949f13e2fe7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391794.072824:0:22778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1790391794.072850:0:22778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e2fd9 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391794.072857:0:22778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e2fd9 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391794.072863:0:22778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e2fd9 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391794.072868:0:22778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52bab9de00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391794.072872:0:22778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e2fd9 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391794.072902:0:22778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e2fd9 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391794.072911:0:22778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e5182c83300) 00010000:00010000:3.0:1790391794.072914:0:22778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391794.072918:0:22778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e2fd9 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391794.072924:0:22778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e2fd9 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790391794.072936:0:22778:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008d9513a8 reply state 000000006841b4c3 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ce00/0x2b1b7949f13e2fe0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391794.072945:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ce00/0x2b1b7949f13e2fe0 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391794.072962:0:22778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9e51821ba100) 00010000:00010000:3.0:1790391794.072964:0:22778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790391794.072966:0:22778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790391794.073001:0:22778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9c800/0x2b1b7949f13e2fd2 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b07dd expref: 15 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391794.073015:0:22778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d400/0x2b1b7949f13e2fe7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b07dd expref: 14 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391794.073022:0:22778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e51821ba600) 00010000:00010000:3.0:1790391794.073024:0:22778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1790391794.073026:0:22778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52bab9d400, rc 0) 00000100:00100000:3.0:1790391794.073212:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c67287cd-8d89-444e-807d-10aa5015d6e5+15:18734:x1877361169691776:12345-192.168.202.28@tcp:101:bash.0 Request processed in 7870us (8096us total) trans 12884901896 rc 0/0 00000100:00100000:3.0:1790391794.073220:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 37 00000100:00100000:0.0:1790391794.089614:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391794.089755:0:23840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169692032 00000100:00100000:2.0:1790391794.089767:0:23840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169692032 00000100:00100000:2.0:1790391794.089827:0:23840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 38 00000100:00100000:2.0:1790391794.089838:0:23840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c67287cd-8d89-444e-807d-10aa5015d6e5+15:18734:x1877361169692032:12345-192.168.202.28@tcp:101:bash.0 00010000:00010000:2.0:1790391794.089862:0:23840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391794.089911:0:23840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb800/0x2b1b7949f13e2ff5 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b07e4 expref: -99 pid: 23840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.089977:0:23840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb400/0x2b1b7949f13e2ffc lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.089991:0:23840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb400/0x2b1b7949f13e2ffc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.090001:0:23840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb400/0x2b1b7949f13e2ffc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391794.090047:0:23840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1790391794.090051:0:23840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790391794.090070:0:23840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb400/0x2b1b7949f13e2ffc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.090079:0:23840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb400/0x2b1b7949f13e2ffc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.090103:0:23840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb800/0x2b1b7949f13e2ff5 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b07e4 expref: 17 pid: 23840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.090145:0:23840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb400/0x2b1b7949f13e2ffc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b07e4 expref: 16 pid: 23840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.090153:0:23840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e51821ba600) 00010000:00010000:2.0:1790391794.090156:0:23840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790391794.090159:0:23840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52a7efb400, rc 0) 00000100:00100000:2.0:1790391794.090210:0:23840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c67287cd-8d89-444e-807d-10aa5015d6e5+16:18734:x1877361169692032:12345-192.168.202.28@tcp:101:bash.0 Request processed in 374us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391794.090217:0:23840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 38 00000100:00100000:1.0:1790391794.095563:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391794.095708:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169692288 00000100:00100000:3.0:1790391794.095719:0:22779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169692288 00000100:00100000:3.0:1790391794.095775:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 5 00000100:00100000:3.0:1790391794.095786:0:22779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+16:18734:x1877361169692288:12345-192.168.202.28@tcp:35:bash.0 00000100:00100000:3.0:1790391794.096108:0:22779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+17:18734:x1877361169692288:12345-192.168.202.28@tcp:35:bash.0 Request processed in 322us (554us total) trans 12884901897 rc 0/0 00000100:00100000:3.0:1790391794.096116:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 5 00000100:00100000:3.0:1790391794.194283:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391794.194439:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169692544 00000100:00100000:2.0:1790391794.194449:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169692544 00000100:00100000:2.0:1790391794.194510:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 39 00000100:00100000:2.0:1790391794.194520:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+17:18744:x1877361169692544:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:2.0:1790391794.194546:0:22777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391794.194568:0:22777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb800/0x2b1b7949f13e3003 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b07eb expref: -99 pid: 22777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391794.194682:0:22777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1790391794.194779:0:22777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb800/0x2b1b7949f13e3003 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b07eb expref: 19 pid: 22777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.194795:0:22777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e51821bad00) 00010000:00010000:2.0:1790391794.194798:0:22777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790391794.194803:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb800/0x2b1b7949f13e3003 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b07eb expref: 19 pid: 22777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.194835:0:22777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52a7efb800, rc 0) 00000100:00100000:2.0:1790391794.194952:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+18:18744:x1877361169692544:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 432us (677us total) trans 12884901898 rc 301/301 00000100:00100000:2.0:1790391794.194960:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 39 00000100:00100000:0.0:1790391794.199271:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391794.199495:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169692800 00000100:00100000:3.0:1790391794.199507:0:22779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169692800 00000100:00100000:3.0:1790391794.199568:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 6 00000100:00100000:3.0:1790391794.199595:0:22779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+18:18744:x1877361169692800:12345-192.168.202.28@tcp:35:lfs.0 00000100:00100000:3.0:1790391794.199834:0:22779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+19:18744:x1877361169692800:12345-192.168.202.28@tcp:35:lfs.0 Request processed in 241us (573us total) trans 12884901899 rc 0/0 00000100:00100000:3.0:1790391794.199842:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 6 00000100:00100000:0.0:1790391794.231796:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391794.231952:0:23840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169693056 00000100:00100000:2.0:1790391794.231963:0:23840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169693056 00000100:00100000:2.0:1790391794.232025:0:23840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 40 00000100:00100000:2.0:1790391794.232037:0:23840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c67287cd-8d89-444e-807d-10aa5015d6e5+19:18747:x1877361169693056:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:2.0:1790391794.232060:0:23840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391794.232082:0:23840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb800/0x2b1b7949f13e3011 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b07f2 expref: -99 pid: 23840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.232198:0:23840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e3018 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.232215:0:23840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e3018 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.232227:0:23840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e3018 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391794.232383:0:23840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790391794.232499:0:23840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb800/0x2b1b7949f13e3011 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b07f2 expref: 22 pid: 23840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.232521:0:23840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e3018 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b07f2 expref: 21 pid: 23840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.232554:0:23840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e51821ba600) 00010000:00010000:2.0:1790391794.232557:0:23840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790391794.232561:0:23840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52a7efa200, rc 0) 00000100:00100000:2.0:1790391794.232626:0:23840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c67287cd-8d89-444e-807d-10aa5015d6e5+21:18747:x1877361169693056:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 591us (841us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1790391794.232635:0:23840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 40 00000100:00100000:0.0:1790391794.235777:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391794.235855:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169693184 00000100:00100000:2.0:1790391794.235865:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169693184 00000100:00100000:2.0:1790391794.235944:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 41 00000100:00100000:2.0:1790391794.235954:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+21:18747:x1877361169693184:12345-192.168.202.28@tcp:54:lfs.0 00010000:00010000:2.0:1790391794.236020:0:22777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efae00/0x2b1b7949f13e3026 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.236036:0:22777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efae00/0x2b1b7949f13e3026 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.236046:0:22777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efae00/0x2b1b7949f13e3026 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.236078:0:22777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efae00/0x2b1b7949f13e3026 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.236085:0:22777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efae00/0x2b1b7949f13e3026 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.236092:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efae00/0x2b1b7949f13e3026 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.236097:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52a7efae00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391794.236115:0:22777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efae00/0x2b1b7949f13e3026 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.236123:0:22777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efae00/0x2b1b7949f13e3026 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.236145:0:22777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e51821ba600) 00010000:00010000:2.0:1790391794.236148:0:22777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790391794.236153:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efae00/0x2b1b7949f13e3026 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.236161:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efae00/0x2b1b7949f13e3026 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391794.236233:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+21:18747:x1877361169693184:12345-192.168.202.28@tcp:54:lfs.0 Request processed in 280us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391794.236250:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 41 00000100:00100000:0.0:1790391794.239124:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391794.239209:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169693440 00000100:00100000:3.0:1790391794.239220:0:22779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169693440 00000100:00100000:3.0:1790391794.239284:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 7 00000100:00100000:3.0:1790391794.239303:0:22779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+21:18747:x1877361169693440:12345-192.168.202.28@tcp:35:lfs.0 00000100:00100000:3.0:1790391794.239513:0:22779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+22:18747:x1877361169693440:12345-192.168.202.28@tcp:35:lfs.0 Request processed in 220us (400us total) trans 12884901901 rc 0/0 00000100:00100000:3.0:1790391794.239520:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 7 00000100:00100000:0.0:1790391794.241767:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391794.241857:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169693568 00000100:00100000:1.0:1790391794.241867:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169693568 00000100:00100000:1.0:1790391794.241967:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 0 00000100:00100000:1.0:1790391794.241979:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+22:2383:x1877361169693568:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391794.241996:0:22762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391794.242022:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e3018 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b07f2 expref: 22 pid: 23840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391794.242042:0:22762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e51821ba600) 00010000:00010000:1.0:1790391794.242047:0:22762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391794.242110:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+21:2383:x1877361169693568:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 133us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391794.242118:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 0 00000040:00080000:3.0:1790391794.248761:0:22810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1790391794.378242:0:23532:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790391794.505321:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790391794.505912:0:22773:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790391794.505917:0:22773:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e5284edc000 from 13 10000000:01000000:3.0:1790391794.505922:0:22773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790391794.505972:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c800/0x2b1b7949f13e302d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391794.505984:0:22773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c800/0x2b1b7949f13e302d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391794.505995:0:22773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c800/0x2b1b7949f13e302d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391794.506023:0:22773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf948700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186586752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790391794.506089:0:22773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391794.506135:0:22773:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52852c9780 going to sleep for 11 seconds 00000100:00100000:2.0:1790391794.506201:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186586752 00000100:00100000:2.0:1790391794.506208:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186586752 00000100:00100000:2.0:1790391794.506262:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1790391794.506271:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+20:22773:x1877361186586752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790391794.506284:0:22770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391794.506311:0:22770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52a7efae00/0x2b1b7949f13e3034 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e302d expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.506333:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52a7efae00/0x2b1b7949f13e3034 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e302d expref: 21 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.506345:0:22770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52a7efae00/0x2b1b7949f13e3034 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e302d expref: 21 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.506372:0:22770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52a7efae00, rc 0) 00000100:00100000:2.0:1790391794.506418:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+21:22773:x1877361186586752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391794.506425:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1790391794.506737:0:22773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf948700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186586752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391794.506758:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c800/0x2b1b7949f13e302d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e3034 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391794.506768:0:22773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c800/0x2b1b7949f13e302d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e3034 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391794.506831:0:22773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf948700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186586880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391794.506860:0:22773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391794.506925:0:22773:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52852c9780 going to sleep for 11 seconds 00000100:00100000:0.0:1790391794.506976:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186586880 00000100:00100000:0.0:1790391794.506981:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186586880 00000100:00100000:0.0:1790391794.507014:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1790391794.507021:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+21:22773:x1877361186586880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391794.507130:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+21:22773:x1877361186586880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391794.507137:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1790391794.507404:0:22773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf948700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186586880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391794.507432:0:22773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf948700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186587008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790391794.507470:0:22773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391794.507491:0:22773:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52852c9780 going to sleep for 11 seconds 00000100:00100000:0.0:1790391794.507629:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186587008 00000100:00100000:0.0:1790391794.507634:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186587008 00000100:00100000:0.0:1790391794.507706:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1790391794.507713:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+21:22773:x1877361186587008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790391794.507793:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+21:22773:x1877361186587008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391794.507799:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1790391794.507905:0:22773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf948700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186587008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790391794.508820:0:25820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1790391794.509156:0:22773:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1790391794.509178:0:22773:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790391794.509189:0:22773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c800/0x2b1b7949f13e302d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e3034 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391794.509200:0:22773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e52bab9c800/0x2b1b7949f13e302d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e3034 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391794.509210:0:22773:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790391794.509213:0:22773:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e52a75c7800 from 13 10000000:01000000:3.0:1790391794.509216:0:22773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790391794.509254:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52bab9de00/0x2b1b7949f13e303b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391794.509276:0:22773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e52bab9de00/0x2b1b7949f13e303b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391794.509287:0:22773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52bab9de00/0x2b1b7949f13e303b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391794.509319:0:22773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf948700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186587136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790391794.509369:0:22773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391794.509411:0:22773:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52852c9780 going to sleep for 11 seconds 00000100:00100000:2.0:1790391794.509572:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186587136 00000100:00100000:2.0:1790391794.509579:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186587136 00000100:00100000:2.0:1790391794.509622:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1790391794.509631:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+21:22773:x1877361186587136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790391794.509642:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391794.509666:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52a7efb800/0x2b1b7949f13e3042 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e303b expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.509687:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52a7efb800/0x2b1b7949f13e3042 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e303b expref: 22 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.510072:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52a7efb800/0x2b1b7949f13e3042 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e303b expref: 22 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.510083:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52a7efb800, rc 0) 00000100:00100000:2.0:1790391794.510127:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+22:22773:x1877361186587136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 497us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391794.510133:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1790391794.510260:0:22773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf948700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186587136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391794.510273:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52bab9de00/0x2b1b7949f13e303b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e3042 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391794.510284:0:22773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52bab9de00/0x2b1b7949f13e303b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e3042 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391794.510357:0:22773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf948700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186587264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391794.510384:0:22773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391794.510406:0:22773:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52852c9780 going to sleep for 11 seconds 00000100:00100000:2.0:1790391794.510577:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186587264 00000100:00100000:2.0:1790391794.510583:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186587264 00000100:00100000:2.0:1790391794.510614:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1790391794.510621:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+22:22773:x1877361186587264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790391794.510789:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+22:22773:x1877361186587264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 167us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391794.510796:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1790391794.511586:0:22773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf948700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186587264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391794.511628:0:22773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186587392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790391794.511692:0:22773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391794.511732:0:22773:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a7edfe40 going to sleep for 11 seconds 00000100:00100000:3.0:1790391794.512496:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186587392 00000100:00100000:3.0:1790391794.512507:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186587392 00000100:00100000:3.0:1790391794.512562:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1790391794.512572:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+22:22773:x1877361186587392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790391794.512709:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+22:22773:x1877361186587392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391794.512716:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1790391794.512869:0:22773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186587392:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790391794.514541:0:25821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1790391794.518513:0:22773:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1790391794.518558:0:22773:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790391794.518573:0:22773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52bab9de00/0x2b1b7949f13e303b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e3042 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391794.518586:0:22773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e52bab9de00/0x2b1b7949f13e303b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e3042 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391794.518597:0:22773:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790391794.518600:0:22773:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e5284985000 from 13 10000000:01000000:3.0:1790391794.518602:0:22773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790391794.518650:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d000/0x2b1b7949f13e3049 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391794.518669:0:22773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d000/0x2b1b7949f13e3049 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391794.518682:0:22773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d000/0x2b1b7949f13e3049 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391794.518721:0:22773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf948700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186587520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790391794.518794:0:22773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391794.518844:0:22773:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52852c9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790391794.518962:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186587520 00000100:00100000:2.0:1790391794.518971:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186587520 00000100:00100000:2.0:1790391794.519015:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1790391794.519025:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+22:22773:x1877361186587520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790391794.519037:0:22770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391794.519050:0:22770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52a7efb600/0x2b1b7949f13e3050 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e3049 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.519072:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52a7efb600/0x2b1b7949f13e3050 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e3049 expref: 23 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.519084:0:22770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52a7efb600/0x2b1b7949f13e3050 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e3049 expref: 23 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.519092:0:22770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52a7efb600, rc 0) 00000100:00100000:2.0:1790391794.519146:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+23:22773:x1877361186587520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391794.519153:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1790391794.519230:0:22773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf948700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186587520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790391794.519244:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d000/0x2b1b7949f13e3049 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e3050 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391794.519252:0:22773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d000/0x2b1b7949f13e3049 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e3050 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391794.519323:0:22773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186587648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391794.519352:0:22773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391794.519379:0:22773:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a7edfc00 going to sleep for 11 seconds 00000100:00100000:2.0:1790391794.519475:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186587648 00000100:00100000:2.0:1790391794.519479:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186587648 00000100:00100000:2.0:1790391794.519507:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1790391794.519513:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+23:22773:x1877361186587648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790391794.519608:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+23:22773:x1877361186587648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 95us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391794.519630:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1790391794.519821:0:22773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186587648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391794.519849:0:22773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186587776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790391794.519916:0:22773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391794.519930:0:22773:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a7edfc00 going to sleep for 11 seconds 00000100:00100000:1.0:1790391794.519997:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186587776 00000100:00100000:1.0:1790391794.520001:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186587776 00000100:00100000:1.0:1790391794.520037:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1790391794.520044:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+23:22773:x1877361186587776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790391794.520125:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+23:22773:x1877361186587776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391794.520132:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1790391794.520327:0:22773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186587776:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790391794.521821:0:25822:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1790391794.522470:0:22773:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1790391794.522495:0:22773:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790391794.522505:0:22773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d000/0x2b1b7949f13e3049 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e3050 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391794.522517:0:22773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d000/0x2b1b7949f13e3049 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e3050 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391794.522541:0:22773:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790391794.522544:0:22773:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e52b56dd000 from 13 10000000:01000000:0.0:1790391794.522546:0:22773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790391794.522580:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e3057 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391794.522588:0:22773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e3057 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391794.522598:0:22773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e3057 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391794.522619:0:22773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186587904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790391794.522683:0:22773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391794.522836:0:22773:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a7edfc00 going to sleep for 11 seconds 00000100:00100000:3.0:1790391794.525001:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186587904 00000100:00100000:3.0:1790391794.525016:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186587904 00000100:00100000:3.0:1790391794.525125:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1790391794.525136:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+23:22773:x1877361186587904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391794.525152:0:22769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391794.525185:0:22769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5280031800/0x2b1b7949f13e305e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e3057 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391794.525234:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5280031800/0x2b1b7949f13e305e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e3057 expref: 24 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391794.525247:0:22769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5280031800/0x2b1b7949f13e305e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e3057 expref: 24 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391794.525256:0:22769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5280031800, rc 0) 00000100:00100000:3.0:1790391794.525551:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+24:22773:x1877361186587904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 417us (2867us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391794.525559:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1790391794.525789:0:22773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186587904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790391794.525809:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e3057 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e305e expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391794.525819:0:22773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e3057 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e305e expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391794.526056:0:22773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186588032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391794.526090:0:22773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391794.526156:0:22773:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a7edfc00 going to sleep for 11 seconds 00000100:00100000:3.0:1790391794.526250:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186588032 00000100:00100000:3.0:1790391794.526255:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186588032 00000100:00100000:3.0:1790391794.526289:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1790391794.526307:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+24:22773:x1877361186588032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391794.526422:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e907dcd1-fffe-43bb-853f-376b925bb229+24:22773:x1877361186588032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 127us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391794.526429:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1790391794.526601:0:22773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186588032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790391794.526638:0:22773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183828e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186588160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790391794.526706:0:22773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391794.526724:0:22773:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a0cedcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391794.527747:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186588160 00000100:00100000:0.0:1790391794.527758:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186588160 00000100:00100000:0.0:1790391794.527821:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1790391794.527829:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+24:22773:x1877361186588160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790391794.528283:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e907dcd1-fffe-43bb-853f-376b925bb229+24:22773:x1877361186588160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 453us (1586us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391794.528291:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1790391794.528393:0:22773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183828e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e907dcd1-fffe-43bb-853f-376b925bb229:22773:1877361186588160:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790391794.529487:0:25823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1790391794.530965:0:22773:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1790391794.530996:0:22773:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790391794.531006:0:22773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e3057 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e305e expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391794.531015:0:22773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e3057 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e305e expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391794.562671:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391794.562800:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169693824 00000100:00100000:2.0:1790391794.562811:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169693824 00000100:00100000:2.0:1790391794.562870:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 42 00000100:00100000:2.0:1790391794.562909:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+21:18778:x1877361169693824:12345-192.168.202.28@tcp:101:cat.0 00010000:00010000:2.0:1790391794.562935:0:22776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391794.562956:0:22776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efaa00/0x2b1b7949f13e3065 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b07f9 expref: -99 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.563065:0:22776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa000/0x2b1b7949f13e306c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.563081:0:22776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa000/0x2b1b7949f13e306c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.563104:0:22776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa000/0x2b1b7949f13e306c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391794.563115:0:22776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790391794.563263:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efaa00/0x2b1b7949f13e3065 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b07f9 expref: 24 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.563282:0:22776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa000/0x2b1b7949f13e306c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b07f9 expref: 23 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.563291:0:22776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e51821ba600) 00010000:00010000:2.0:1790391794.563359:0:22776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790391794.563378:0:22776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52a7efa000, rc 0) 00000100:00100000:2.0:1790391794.563421:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+23:18778:x1877361169693824:12345-192.168.202.28@tcp:101:cat.0 Request processed in 544us (770us total) trans 12884901902 rc 0/0 00000100:00100000:2.0:1790391794.563426:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 42 00000100:00100000:0.0:1790391794.568171:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391794.568220:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391794.568352:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169694208 00000100:00100000:2.0:1790391794.568362:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169694208 00000100:00100000:2.0:1790391794.568427:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 1 00000100:00100000:2.0:1790391794.568437:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292338e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+23:2381:x1877361169694208:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391794.568451:0:22761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391794.568475:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa000/0x2b1b7949f13e306c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b07f9 expref: 23 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.568494:0:22761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e51821ba600) 00010000:00010000:2.0:1790391794.568499:0:22761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391794.568551:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292338e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+22:2381:x1877361169694208:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 116us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391794.568559:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 1 00000100:00100000:3.0:1790391794.568958:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169694080 00000100:00100000:3.0:1790391794.568964:0:22779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169694080 00000100:00100000:3.0:1790391794.569004:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 8 00000100:00100000:3.0:1790391794.569012:0:22779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292339c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+22:18778:x1877361169694080:12345-192.168.202.28@tcp:35:cat.0 00000100:00100000:3.0:1790391794.569447:0:22779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292339c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+23:18778:x1877361169694080:12345-192.168.202.28@tcp:35:cat.0 Request processed in 434us (1284us total) trans 12884901903 rc 0/0 00000100:00100000:3.0:1790391794.569454:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 8 00000100:00100000:0.0:1790391794.688988:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391794.689304:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169694464 00000100:00100000:2.0:1790391794.689315:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169694464 00000100:00100000:2.0:1790391794.689382:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 43 00000100:00100000:2.0:1790391794.689392:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+23:18784:x1877361169694464:12345-192.168.202.28@tcp:101:dd.0 00010000:00010000:2.0:1790391794.689417:0:22777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391794.689437:0:22777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa000/0x2b1b7949f13e307a lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0800 expref: -99 pid: 22777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.689550:0:22777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efaa00/0x2b1b7949f13e3081 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.689582:0:22777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efaa00/0x2b1b7949f13e3081 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.689597:0:22777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efaa00/0x2b1b7949f13e3081 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391794.689610:0:22777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790391794.689750:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa000/0x2b1b7949f13e307a lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0800 expref: 26 pid: 22777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.689769:0:22777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efaa00/0x2b1b7949f13e3081 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0800 expref: 25 pid: 22777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.689778:0:22777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e51821ba600) 00010000:00010000:2.0:1790391794.689781:0:22777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790391794.689785:0:22777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52a7efaa00, rc 0) 00000100:00100000:2.0:1790391794.689851:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+25:18784:x1877361169694464:12345-192.168.202.28@tcp:101:dd.0 Request processed in 461us (874us total) trans 12884901904 rc 0/0 00000100:00100000:2.0:1790391794.689858:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 43 00000100:00100000:0.0:1790391794.694704:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391794.695817:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169694592 00000100:00100000:2.0:1790391794.695834:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169694592 00000100:00100000:2.0:1790391794.695947:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 44 00000100:00100000:2.0:1790391794.695960:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292339f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+25:18784:x1877361169694592:12345-192.168.202.28@tcp:101:dd.0 00010000:00010000:2.0:1790391794.695989:0:22776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391794.696015:0:22776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa000/0x2b1b7949f13e308f lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0807 expref: -99 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.696076:0:22776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb000/0x2b1b7949f13e3096 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.696091:0:22776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb000/0x2b1b7949f13e3096 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.696103:0:22776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb000/0x2b1b7949f13e3096 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391794.696204:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391794.696363:0:25806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169694720 00000100:00100000:3.0:1790391794.696367:0:25806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169694720 00010000:00010000:2.0:1790391794.696392:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa000/0x2b1b7949f13e308f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0807 expref: 28 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.696410:0:22776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb000/0x2b1b7949f13e3096 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0807 expref: 27 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391794.696414:0:25806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 2 00010000:00010000:2.0:1790391794.696419:0:22776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e51821ba600) 00000100:00100000:3.0:1790391794.696421:0:25806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529233ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c67287cd-8d89-444e-807d-10aa5015d6e5+27:2382:x1877361169694720:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391794.696422:0:22776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790391794.696426:0:22776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52a7efb000, rc 0) 00010000:00010000:3.0:1790391794.696430:0:25806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391794.696443:0:25806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efaa00/0x2b1b7949f13e3081 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0800 expref: 27 pid: 22777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391794.696452:0:25806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e51821ba600) 00010000:00010000:3.0:1790391794.696455:0:25806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391794.696533:0:25806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529233ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c67287cd-8d89-444e-807d-10aa5015d6e5+26:2382:x1877361169694720:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 60us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391794.696541:0:25806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 2 00000100:00100000:2.0:1790391794.696787:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292339f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+25:18784:x1877361169694592:12345-192.168.202.28@tcp:101:dd.0 Request processed in 830us (2093us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391794.696794:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 44 00000100:00100000:0.0:1790391794.705502:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391794.705691:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169694976 00000100:00100000:2.0:1790391794.705702:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169694976 00000100:00100000:2.0:1790391794.705766:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 45 00000100:00100000:2.0:1790391794.705776:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292338380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+25:18784:x1877361169694976:12345-192.168.202.28@tcp:36:dd.0 00010000:00010000:2.0:1790391794.705836:0:22777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391794.705868:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb400/0x2b1b7949f13e2ffc lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b07e4 expref: 25 pid: 23840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.705945:0:22777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e51821ba600) 00010000:00010000:2.0:1790391794.705950:0:22777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790391794.706125:0:22777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa000/0x2b1b7949f13e309d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.706141:0:22777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa000/0x2b1b7949f13e309d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.706153:0:22777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa000/0x2b1b7949f13e309d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790391794.706214:0:22777:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:2.0:1790391794.706254:0:22777:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000078d3a53f reply state 0000000003812a43 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa000/0x2b1b7949f13e309d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.706266:0:22777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa000/0x2b1b7949f13e309d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391794.706272:0:22777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e51821ba600) 00010000:00010000:2.0:1790391794.706275:0:22777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790391794.706278:0:22777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790391794.706382:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292338380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+27:18784:x1877361169694976:12345-192.168.202.28@tcp:36:dd.0 Request processed in 605us (890us total) trans 12884901906 rc 0/0 00000100:00100000:2.0:1790391794.706390:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 45 00000020:00080000:2.0:1790391794.706395:0:22777:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790391794.820150:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391794.820386:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169695232 00000100:00100000:1.0:1790391794.820397:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169695232 00000100:00100000:1.0:1790391794.820457:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 9 00000100:00100000:1.0:1790391794.820468:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+27:18784:x1877361169695232:12345-192.168.202.28@tcp:35:dd.0 00000100:00100000:1.0:1790391794.820706:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+28:18784:x1877361169695232:12345-192.168.202.28@tcp:35:dd.0 Request processed in 238us (566us total) trans 12884901907 rc 0/0 00000100:00100000:1.0:1790391794.820713:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 9 00000100:00100000:0.0:1790391795.145941:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391795.146841:0:23840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169695360 00000100:00100000:1.0:1790391795.146869:0:23840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169695360 00000100:00100000:1.0:1790391795.146973:0:23840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 46 00000100:00100000:1.0:1790391795.146986:0:23840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529233b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c67287cd-8d89-444e-807d-10aa5015d6e5+28:18799:x1877361169695360:12345-192.168.202.28@tcp:101:stat.0 00010000:00010000:1.0:1790391795.147009:0:23840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391795.147030:0:23840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d000/0x2b1b7949f13e30a4 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b080e expref: -99 pid: 23840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391795.147112:0:23840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e30ab lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391795.147135:0:23840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e30ab lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391795.147148:0:23840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e30ab lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391795.147158:0:23840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e30b2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391795.147166:0:23840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e30b2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391795.147171:0:23840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e30b2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391795.147258:0:23840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e30b9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391795.147267:0:23840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e30b9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391795.147273:0:23840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e30b9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391795.147334:0:23840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1790391795.147339:0:23840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790391795.147389:0:23840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e30b9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391795.147403:0:23840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e30b9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391795.147410:0:23840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e30ab lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391795.147416:0:23840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e30ab lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391795.147422:0:23840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e30ab lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391795.147428:0:23840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763c800 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:1.0:1790391795.147432:0:23840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e30ab lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391795.147439:0:23840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e30ab lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391795.147450:0:23840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e5182c83300) 00010000:00010000:1.0:1790391795.147453:0:23840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391795.147457:0:23840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e30ab lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391795.147463:0:23840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e30ab lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391795.147489:0:23840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e30b2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391795.147496:0:23840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e30b2 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391795.147502:0:23840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e30b2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391795.147506:0:23840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763c200 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:1.0:1790391795.147509:0:23840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e30b2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391795.147516:0:23840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e30b2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391795.147523:0:23840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9e51821ba100) 00010000:00010000:1.0:1790391795.147525:0:23840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391795.147528:0:23840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e30b2 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391795.147534:0:23840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e30b2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391795.147559:0:23840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d000/0x2b1b7949f13e30a4 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b080e expref: 30 pid: 23840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391795.147572:0:23840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e30b9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b080e expref: 29 pid: 23840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391795.147590:0:23840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e51821ba600) 00010000:00010000:1.0:1790391795.147592:0:23840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790391795.147595:0:23840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b763da00, rc 0) 00000100:00100000:1.0:1790391795.147698:0:23840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529233b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c67287cd-8d89-444e-807d-10aa5015d6e5+29:18799:x1877361169695360:12345-192.168.202.28@tcp:101:stat.0 Request processed in 715us (1765us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391795.147706:0:23840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 46 00000100:00080000:2.0:1790391795.148859:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790391795.211142:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391795.211333:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169695616 00000100:00100000:2.0:1790391795.211344:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169695616 00000100:00100000:2.0:1790391795.211410:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 47 00000100:00100000:2.0:1790391795.211421:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529233a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+29:18805:x1877361169695616:12345-192.168.202.28@tcp:36:truncate.0 00010000:00010000:2.0:1790391795.211489:0:22777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391795.211516:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e30b9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b080e expref: 29 pid: 23840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.211536:0:22777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e51821ba600) 00010000:00010000:2.0:1790391795.211540:0:22777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790391795.211746:0:22777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb400/0x2b1b7949f13e30c0 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.211760:0:22777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb400/0x2b1b7949f13e30c0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.211770:0:22777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb400/0x2b1b7949f13e30c0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790391795.211811:0:22777:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901908 00000004:00010000:2.0:1790391795.211832:0:22777:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000481ec885 reply state 0000000009ef6576 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb400/0x2b1b7949f13e30c0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.211842:0:22777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb400/0x2b1b7949f13e30c0 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.211849:0:22777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e51821ba600) 00010000:00010000:2.0:1790391795.211851:0:22777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790391795.211854:0:22777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790391795.212018:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529233a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+31:18805:x1877361169695616:12345-192.168.202.28@tcp:36:truncate.0 Request processed in 598us (899us total) trans 12884901909 rc 0/0 00000100:00100000:2.0:1790391795.212026:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 47 00000020:00080000:2.0:1790391795.212031:0:22777:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1790391795.394660:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391795.394776:0:23840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169695744 00000100:00100000:2.0:1790391795.394801:0:23840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169695744 00000100:00100000:2.0:1790391795.394867:0:23840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 48 00000100:00100000:2.0:1790391795.394926:0:23840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c67287cd-8d89-444e-807d-10aa5015d6e5+31:18819:x1877361169695744:12345-192.168.202.28@tcp:101:stat.0 00010000:00010000:2.0:1790391795.394947:0:23840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391795.394967:0:23840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efbc00/0x2b1b7949f13e30c7 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0815 expref: -99 pid: 23840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.395025:0:23840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efac00/0x2b1b7949f13e30ce lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.395039:0:23840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efac00/0x2b1b7949f13e30ce lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.395050:0:23840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efac00/0x2b1b7949f13e30ce lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.395061:0:23840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa600/0x2b1b7949f13e30d5 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.395068:0:23840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa600/0x2b1b7949f13e30d5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.395075:0:23840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa600/0x2b1b7949f13e30d5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.395142:0:23840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efaa00/0x2b1b7949f13e30dc lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.395150:0:23840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efaa00/0x2b1b7949f13e30dc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.395156:0:23840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efaa00/0x2b1b7949f13e30dc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391795.395204:0:23840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:2.0:1790391795.395208:0:23840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790391795.395236:0:23840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efaa00/0x2b1b7949f13e30dc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.395248:0:23840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efaa00/0x2b1b7949f13e30dc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.395256:0:23840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efac00/0x2b1b7949f13e30ce lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.395263:0:23840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efac00/0x2b1b7949f13e30ce lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.395269:0:23840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efac00/0x2b1b7949f13e30ce lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.395275:0:23840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52a7efac00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391795.395279:0:23840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efac00/0x2b1b7949f13e30ce lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.395286:0:23840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efac00/0x2b1b7949f13e30ce lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.395297:0:23840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e5182c83300) 00010000:00010000:2.0:1790391795.395300:0:23840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391795.395304:0:23840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efac00/0x2b1b7949f13e30ce lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.395310:0:23840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efac00/0x2b1b7949f13e30ce lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.395333:0:23840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa600/0x2b1b7949f13e30d5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.395339:0:23840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa600/0x2b1b7949f13e30d5 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.395345:0:23840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa600/0x2b1b7949f13e30d5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.395350:0:23840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52a7efa600 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391795.395353:0:23840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa600/0x2b1b7949f13e30d5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.395358:0:23840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa600/0x2b1b7949f13e30d5 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.395365:0:23840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9e51821ba100) 00010000:00010000:2.0:1790391795.395367:0:23840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391795.395369:0:23840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa600/0x2b1b7949f13e30d5 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.395375:0:23840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa600/0x2b1b7949f13e30d5 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.395397:0:23840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efbc00/0x2b1b7949f13e30c7 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0815 expref: 33 pid: 23840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.395408:0:23840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efaa00/0x2b1b7949f13e30dc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0815 expref: 32 pid: 23840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.395424:0:23840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e51821ba600) 00010000:00010000:2.0:1790391795.395426:0:23840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790391795.395429:0:23840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52a7efaa00, rc 0) 00000100:00100000:2.0:1790391795.395488:0:23840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c67287cd-8d89-444e-807d-10aa5015d6e5+32:18819:x1877361169695744:12345-192.168.202.28@tcp:101:stat.0 Request processed in 613us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391795.395495:0:23840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 48 00000100:00100000:0.0:1790391795.513574:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391795.514019:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169696000 00000100:00100000:2.0:1790391795.514031:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169696000 00000100:00100000:2.0:1790391795.514091:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 49 00000100:00100000:2.0:1790391795.514101:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+32:18829:x1877361169696000:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:2.0:1790391795.514122:0:22777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391795.514143:0:22777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efbc00/0x2b1b7949f13e30e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b081c expref: -99 pid: 22777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391795.514252:0:22777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1790391795.514348:0:22777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efbc00/0x2b1b7949f13e30e3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b081c expref: 34 pid: 22777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.514363:0:22777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e51821bad00) 00010000:00010000:2.0:1790391795.514366:0:22777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790391795.514372:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efbc00/0x2b1b7949f13e30e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b081c expref: 34 pid: 22777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.514387:0:22777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52a7efbc00, rc 0) 00000100:00100000:2.0:1790391795.514450:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+33:18829:x1877361169696000:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 350us (886us total) trans 12884901910 rc 301/301 00000100:00100000:2.0:1790391795.514472:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 49 00000100:00100000:0.0:1790391795.522105:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391795.522202:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169696256 00000100:00100000:1.0:1790391795.522212:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169696256 00000100:00100000:1.0:1790391795.522271:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 10 00000100:00100000:1.0:1790391795.522282:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52baa41050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+33:18829:x1877361169696256:12345-192.168.202.28@tcp:35:lfs.0 00000100:00100000:1.0:1790391795.522510:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52baa41050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+34:18829:x1877361169696256:12345-192.168.202.28@tcp:35:lfs.0 Request processed in 230us (415us total) trans 12884901911 rc 0/0 00000100:00100000:1.0:1790391795.522517:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 10 00010000:00010000:0.0:1790391795.529286:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391795.609524:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391795.609848:0:23840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169696512 00000100:00100000:2.0:1790391795.609859:0:23840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169696512 00000100:00100000:2.0:1790391795.610015:0:23840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 50 00000100:00100000:2.0:1790391795.610027:0:23840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c67287cd-8d89-444e-807d-10aa5015d6e5+34:18835:x1877361169696512:12345-192.168.202.28@tcp:101:bash.0 00010000:00010000:2.0:1790391795.610050:0:23840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391795.610082:0:23840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efbc00/0x2b1b7949f13e30f1 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0823 expref: -99 pid: 23840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.610188:0:23840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa600/0x2b1b7949f13e30f8 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.610348:0:23840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d400/0x2b1b7949f13e2fe7 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b07dd expref: 35 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.610359:0:23840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efaa00/0x2b1b7949f13e30dc lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0815 expref: 35 pid: 23840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.610369:0:23840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa600/0x2b1b7949f13e30f8 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.610404:0:23840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efaa00/0x2b1b7949f13e30dc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0815 expref: 35 pid: 23840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.610418:0:23840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efaa00/0x2b1b7949f13e30dc lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0815 expref: 35 pid: 23840 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391795.610433:0:23840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831b8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23840:1877361186588288:192.168.202.28@tcp:104: 00010000:00010000:2.0:1790391795.610591:0:23840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d400/0x2b1b7949f13e2fe7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b07dd expref: 35 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.610601:0:23840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d400/0x2b1b7949f13e2fe7 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b07dd expref: 35 pid: 22778 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391795.610612:0:23840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831b9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23840:1877361186588416:192.168.202.28@tcp:104: 00000100:00100000:2.0:1790391795.610666:0:23840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290bff300 going to sleep for 11 seconds 00000100:00100000:0.0:1790391795.621522:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391795.622446:0:23840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831b8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23840:1877361186588288:192.168.202.28@tcp:104: 00000100:00100000:2.0:1790391795.622460:0:23840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831b9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23840:1877361186588416:192.168.202.28@tcp:104: 00010000:00010000:2.0:1790391795.622489:0:23840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa600/0x2b1b7949f13e30f8 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391795.624361:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169696640 00000100:00100000:3.0:1790391795.624378:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169696640 00010000:00010000:3.0:1790391795.624431:0:22763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efaa00/0x2b1b7949f13e30dc lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0815 expref: 36 pid: 23840 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391795.624489:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 17 00000100:00100000:3.0:1790391795.624499:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c67287cd-8d89-444e-807d-10aa5015d6e5+36:2384:x1877361169696640:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790391795.624512:0:22763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391795.624519:0:22763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efaa00/0x2b1b7949f13e30dc lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0815 expref: 36 pid: 23840 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391795.624533:0:22763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efaa00/0x2b1b7949f13e30dc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0815 expref: 36 pid: 23840 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391795.624557:0:22763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efaa00/0x2b1b7949f13e30dc lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0815 expref: 36 pid: 23840 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391795.624596:0:22763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e51821ba600) 00010000:00010000:3.0:1790391795.624602:0:22763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa600/0x2b1b7949f13e30f8 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391795.624610:0:22763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa600/0x2b1b7949f13e30f8 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391795.624616:0:22763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391795.630939:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c67287cd-8d89-444e-807d-10aa5015d6e5+35:2384:x1877361169696640:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 6425us (9412us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391795.630956:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 17 00000100:00100000:2.0:1790391795.635863:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391795.635940:0:25807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169696768 00000100:00100000:3.0:1790391795.635951:0:25807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169696768 00010000:00010000:3.0:1790391795.635995:0:25807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d400/0x2b1b7949f13e2fe7 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b07dd expref: 35 pid: 22778 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391795.636041:0:25807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 18 00000100:00100000:3.0:1790391795.636052:0:25807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c67287cd-8d89-444e-807d-10aa5015d6e5+35:2384:x1877361169696768:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790391795.636078:0:25807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391795.636085:0:25807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d400/0x2b1b7949f13e2fe7 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b07dd expref: 35 pid: 22778 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391795.636099:0:25807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d400/0x2b1b7949f13e2fe7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b07dd expref: 35 pid: 22778 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391795.636121:0:25807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d400/0x2b1b7949f13e2fe7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b07dd expref: 35 pid: 22778 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391795.636154:0:25807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e51821ba600) 00010000:00010000:3.0:1790391795.636159:0:25807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa600/0x2b1b7949f13e30f8 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391795.636168:0:25807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa600/0x2b1b7949f13e30f8 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391795.636176:0:25807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa600/0x2b1b7949f13e30f8 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391795.636200:0:25807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391795.636248:0:25807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c67287cd-8d89-444e-807d-10aa5015d6e5+34:2384:x1877361169696768:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 197us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391795.636255:0:25807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 18 00010000:00010000:2.0:1790391795.636463:0:23840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa600/0x2b1b7949f13e30f8 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.636472:0:23840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa600/0x2b1b7949f13e30f8 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391795.636490:0:23840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:2.0:1790391795.636612:0:23840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efbc00/0x2b1b7949f13e30f1 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0823 expref: 35 pid: 23840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.636628:0:23840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa600/0x2b1b7949f13e30f8 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0823 expref: 34 pid: 23840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.636667:0:23840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e51821ba600) 00010000:00010000:2.0:1790391795.636670:0:23840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790391795.636673:0:23840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52a7efa600, rc 0) 00000100:00100000:2.0:1790391795.636697:0:23840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c67287cd-8d89-444e-807d-10aa5015d6e5+34:18835:x1877361169696512:12345-192.168.202.28@tcp:101:bash.0 Request processed in 26674us (27184us total) trans 12884901912 rc 0/0 00000100:00100000:2.0:1790391795.636704:0:23840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 50 00000100:00100000:0.0:1790391795.646376:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391795.648076:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169697024 00000100:00100000:2.0:1790391795.648092:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169697024 00000100:00100000:2.0:1790391795.648162:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 51 00000100:00100000:2.0:1790391795.648174:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529233a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+34:18835:x1877361169697024:12345-192.168.202.28@tcp:36:bash.0 00010000:00010000:2.0:1790391795.648413:0:22777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efac00/0x2b1b7949f13e3106 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.648432:0:22777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efac00/0x2b1b7949f13e3106 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.648445:0:22777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efac00/0x2b1b7949f13e3106 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790391795.648488:0:22777:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000004:00010000:2.0:1790391795.648509:0:22777:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002bc257ac reply state 0000000085eab8cd transno 12884901914 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efac00/0x2b1b7949f13e3106 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.648522:0:22777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efac00/0x2b1b7949f13e3106 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.648529:0:22777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e51821ba600) 00010000:00010000:2.0:1790391795.648532:0:22777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790391795.648548:0:22777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790391795.648661:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529233a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+37:18835:x1877361169697024:12345-192.168.202.28@tcp:36:bash.0 Request processed in 488us (2295us total) trans 12884901914 rc 0/0 00000100:00100000:2.0:1790391795.648669:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 51 00000020:00080000:2.0:1790391795.648674:0:22777:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790391795.658856:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391795.661867:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169697152 00000100:00100000:3.0:1790391795.661894:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169697152 00000100:00100000:0.0:1790391795.665187:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 52 00000100:00100000:0.0:1790391795.665204:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529233b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+37:18835:x1877361169697152:12345-192.168.202.28@tcp:101:bash.0 00010000:00010000:0.0:1790391795.665233:0:22776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391795.665256:0:22776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144400/0x2b1b7949f13e310d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b082a expref: -99 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391795.665319:0:22776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144400/0x2b1b7949f13e310d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b082a expref: 38 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391795.665335:0:22776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144400/0x2b1b7949f13e310d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b082a expref: 38 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391795.665354:0:22776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e51821ba600) 00010000:00010000:0.0:1790391795.665358:0:22776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790391795.665362:0:22776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5295144400, rc 0) 00000100:00100000:0.0:1790391795.665438:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529233b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+38:18835:x1877361169697152:12345-192.168.202.28@tcp:101:bash.0 Request processed in 238us (6592us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391795.665445:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 52 00000100:00100000:0.0:1790391795.673442:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391795.673539:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169697280 00000100:00100000:2.0:1790391795.673549:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169697280 00000100:00100000:2.0:1790391795.673612:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 53 00000100:00100000:2.0:1790391795.673622:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529233bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+38:18835:x1877361169697280:12345-192.168.202.28@tcp:101:bash.0 00010000:00010000:2.0:1790391795.673660:0:22777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391795.673681:0:22777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efbc00/0x2b1b7949f13e3114 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0831 expref: -99 pid: 22777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.673779:0:22777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa400/0x2b1b7949f13e311b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.673795:0:22777:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa600/0x2b1b7949f13e30f8 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0823 expref: 39 pid: 23840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.673805:0:22777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa400/0x2b1b7949f13e311b lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.673839:0:22777:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa600/0x2b1b7949f13e30f8 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0823 expref: 39 pid: 23840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.673853:0:22777:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa600/0x2b1b7949f13e30f8 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0823 expref: 39 pid: 23840 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391795.673868:0:22777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831b8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22777:1877361186588544:192.168.202.28@tcp:104: 00000100:00100000:2.0:1790391795.673998:0:22777:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290bff780 going to sleep for 11 seconds 00000100:00100000:3.0:1790391795.677328:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391795.677730:0:25806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169697408 00000100:00100000:0.0:1790391795.677740:0:25806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169697408 00010000:00010000:0.0:1790391795.677793:0:25806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa600/0x2b1b7949f13e30f8 lrc: 5/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0823 expref: 40 pid: 23840 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391795.677842:0:25806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 19 00000100:00100000:0.0:1790391795.677853:0:25806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf948700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c67287cd-8d89-444e-807d-10aa5015d6e5+40:2383:x1877361169697408:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790391795.677925:0:25806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391795.677934:0:25806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa600/0x2b1b7949f13e30f8 lrc: 5/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0823 expref: 40 pid: 23840 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391795.677948:0:25806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa600/0x2b1b7949f13e30f8 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0823 expref: 40 pid: 23840 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391795.677971:0:25806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e51821ba600) 00010000:00010000:0.0:1790391795.677976:0:25806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa400/0x2b1b7949f13e311b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391795.677987:0:25806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa400/0x2b1b7949f13e311b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391795.678000:0:25806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa400/0x2b1b7949f13e311b lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391795.678023:0:25806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391795.678092:0:25806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf948700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c67287cd-8d89-444e-807d-10aa5015d6e5+40:2383:x1877361169697408:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 241us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391795.678100:0:25806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 19 00010000:00010000:2.0:1790391795.678442:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa600/0x2b1b7949f13e30f8 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0823 expref: 39 pid: 23840 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391795.678461:0:22777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831b8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22777:1877361186588544:192.168.202.28@tcp:104: 00010000:00010000:2.0:1790391795.678483:0:22777:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa400/0x2b1b7949f13e311b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.678492:0:22777:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa400/0x2b1b7949f13e311b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.678498:0:22777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa400/0x2b1b7949f13e311b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391795.678552:0:22777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1790391795.678557:0:22777:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790391795.678578:0:22777:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa400/0x2b1b7949f13e311b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.678607:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efbc00/0x2b1b7949f13e3114 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0831 expref: 39 pid: 22777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.678621:0:22777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa400/0x2b1b7949f13e311b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0831 expref: 38 pid: 22777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391795.678628:0:22777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e51821ba600) 00010000:00010000:2.0:1790391795.678631:0:22777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790391795.678633:0:22777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52a7efa400, rc 0) 00000100:00100000:2.0:1790391795.678672:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529233bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+38:18835:x1877361169697280:12345-192.168.202.28@tcp:101:bash.0 Request processed in 5052us (5240us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391795.678689:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 53 00000100:00100000:0.0:1790391795.683010:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391795.683096:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169697664 00000100:00100000:3.0:1790391795.683108:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169697664 00000100:00100000:3.0:1790391795.683749:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 3 00000100:00100000:3.0:1790391795.683762:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292338a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c67287cd-8d89-444e-807d-10aa5015d6e5+38:18835:x1877361169697664:12345-192.168.202.28@tcp:103:bash.0 00010000:00010000:3.0:1790391795.683777:0:22763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1790391795.683802:0:22763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144400/0x2b1b7949f13e310d lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b082a expref: 38 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391795.683825:0:22763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa400/0x2b1b7949f13e311b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0831 expref: 37 pid: 22777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391795.683858:0:22763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e51821ba600) 00010000:00010000:3.0:1790391795.683864:0:22763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391795.683998:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292338a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c67287cd-8d89-444e-807d-10aa5015d6e5+36:18835:x1877361169697664:12345-192.168.202.28@tcp:103:bash.0 Request processed in 238us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391795.684007:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 3 00000100:00100000:1.0:1790391795.693786:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391795.694132:0:23840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169697792 00000100:00100000:3.0:1790391795.694143:0:23840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169697792 00000100:00100000:3.0:1790391795.694201:0:23840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 54 00000100:00100000:3.0:1790391795.694210:0:23840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c67287cd-8d89-444e-807d-10aa5015d6e5+36:18835:x1877361169697792:12345-192.168.202.28@tcp:58:bash.0 00010000:00010000:3.0:1790391795.694369:0:23840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030e00/0x2b1b7949f13e3122 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391795.694388:0:23840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030e00/0x2b1b7949f13e3122 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391795.694401:0:23840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030e00/0x2b1b7949f13e3122 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790391795.696570:0:23840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790391795.696601:0:23840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:3.0:1790391795.696720:0:23840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:3.0:1790391795.696829:0:23840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c67287cd-8d89-444e-807d-10aa5015d6e5+36:18835:x1877361169697792:12345-192.168.202.28@tcp:58:bash.0 Request processed in 2614us (3048us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391795.696839:0:23840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 54 00000100:00100000:1.0:1790391795.703871:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391795.703995:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169697920 00000100:00100000:3.0:1790391795.704005:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169697920 00000100:00100000:3.0:1790391795.704069:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 55 00000100:00100000:3.0:1790391795.704080:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c67287cd-8d89-444e-807d-10aa5015d6e5+36:18835:x1877361169697920:12345-192.168.202.28@tcp:101:bash.0 00010000:00010000:3.0:1790391795.704112:0:22778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391795.704141:0:22778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030000/0x2b1b7949f13e3129 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0838 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391795.704198:0:22778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030e00/0x2b1b7949f13e3122 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391795.704210:0:22778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030000/0x2b1b7949f13e3129 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0838 expref: 37 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391795.704228:0:22778:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030e00/0x2b1b7949f13e3122 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391795.704242:0:22778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030000/0x2b1b7949f13e3129 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0838 expref: 37 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391795.704255:0:22778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e51821ba600) 00010000:00010000:3.0:1790391795.704258:0:22778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790391795.704262:0:22778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030000/0x2b1b7949f13e3129 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0838 expref: 37 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391795.704271:0:22778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5280030000, rc 0) 00000100:00100000:3.0:1790391795.704331:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c67287cd-8d89-444e-807d-10aa5015d6e5+37:18835:x1877361169697920:12345-192.168.202.28@tcp:101:bash.0 Request processed in 252us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391795.704339:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 55 00000100:00100000:0.0:1790391796.104295:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391796.104473:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391796.104562:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169698176 00000100:00100000:2.0:1790391796.104571:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169698176 00000100:00100000:2.0:1790391796.104654:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 55 00000100:00100000:2.0:1790391796.104665:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529233aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+37:2384:x1877361169698176:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391796.104735:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529233aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+37:2384:x1877361169698176:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 73us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391796.104741:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 55 00000100:00100000:0.0:1790391796.108950:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391796.108983:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391796.109050:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169698688 00000100:00100000:2.0:1790391796.109060:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169698688 00000100:00080000:2.0:1790391796.109093:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790391796.109141:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 56 00000100:00100000:2.0:1790391796.109151:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529233b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06a5f5e7-5ead-4721-91c8-25641992d7dd+12:2384:x1877361169698688:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391796.109219:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529233b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06a5f5e7-5ead-4721-91c8-25641992d7dd+12:2384:x1877361169698688:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 69us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391796.109226:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 56 00000100:00100000:0.0:1790391796.114993:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391796.115153:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169698048 00000100:00100000:1.0:1790391796.115164:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169698048 00000100:00100000:1.0:1790391796.115232:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 167 00000100:00100000:1.0:1790391796.115243:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87c34307-e556-4f71-950f-f0a41a7cdef6+13:2384:x1877361169698048:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391796.115318:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87c34307-e556-4f71-950f-f0a41a7cdef6+13:2384:x1877361169698048:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 76us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391796.115326:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 167 00000100:00100000:3.0:1790391796.116022:0:24286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169698432 00000100:00100000:3.0:1790391796.116029:0:24286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169698432 00000100:00100000:3.0:1790391796.116409:0:24286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169698944 00000100:00100000:3.0:1790391796.116421:0:24286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169698944 00000100:00100000:1.0:1790391796.116492:0:24285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 16 00000100:00100000:1.0:1790391796.116503:0:24285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292339500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+5:2384:x1877361169698432:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391796.116571:0:24285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292339500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+5:2384:x1877361169698432:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 70us (12097us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391796.116579:0:24285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 16 00000100:00100000:1.0:1790391796.116630:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391796.116725:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391796.116747:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391796.116766:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391796.116780:0:24285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169698560 00000100:00100000:1.0:1790391796.116784:0:24285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169698560 00000100:00080000:0.0:1790391796.117121:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790391796.117126:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790391796.117147:0:24284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169699072 00000100:00100000:0.0:1790391796.117151:0:24284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169699072 00000100:00100000:0.0:1790391796.117182:0:24284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 17 00000100:00100000:0.0:1790391796.117189:0:24284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:06a5f5e7-5ead-4721-91c8-25641992d7dd+5:2384:x1877361169699072:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391796.117244:0:24284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:06a5f5e7-5ead-4721-91c8-25641992d7dd+5:2384:x1877361169699072:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 54us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391796.117251:0:24284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 17 00000100:00080000:0.0:1790391796.117270:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790391796.117328:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169698304 00000100:00100000:2.0:1790391796.118033:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169698816 00000100:00100000:2.0:1790391796.118041:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169698816 00000100:00100000:2.0:1790391796.118086:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 57 00000100:00100000:2.0:1790391796.118096:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06a5f5e7-5ead-4721-91c8-25641992d7dd+5:2384:x1877361169698816:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391796.118153:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06a5f5e7-5ead-4721-91c8-25641992d7dd+5:2384:x1877361169698816:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 59us (1404us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391796.118160:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 57 00000100:00080000:2.0:1790391796.118178:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790391796.118344:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169698304 00000100:00100000:2.0:1790391796.118548:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 58 00000100:00100000:2.0:1790391796.118566:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+5:2384:x1877361169698304:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391796.118598:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+5:2384:x1877361169698304:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 34us (1968us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391796.118605:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 58 00000100:00080000:0.0:1790391796.119072:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790391796.119496:0:24286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 18 00000100:00100000:3.0:1790391796.119506:0:24286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292338700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:06a5f5e7-5ead-4721-91c8-25641992d7dd+5:2384:x1877361169698944:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:3.0:1790391796.119564:0:24286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292338700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:06a5f5e7-5ead-4721-91c8-25641992d7dd+5:2384:x1877361169698944:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 60us (10579us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391796.120161:0:24285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 19 00000100:00100000:1.0:1790391796.120171:0:24285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+5:2384:x1877361169698560:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391796.120211:0:24285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+5:2384:x1877361169698560:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 42us (3486us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391796.120218:0:24285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 19 00000100:00100000:3.0:1790391796.122140:0:24286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 18 00000040:00080000:3.0:1790391796.299178:0:22810:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1790391796.299188:0:22810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790391796.299228:0:22810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1790391796.299240:0:22810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1790391796.299371:0:22810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288345880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22810:1877361186588672:192.168.202.28@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790391796.299520:0:22810:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52852c9d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790391796.315583:0:22810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288345880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22810:1877361186588672:192.168.202.28@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790391796.318492:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391796.319678:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169699200 00000100:00100000:0.0:1790391796.319691:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169699200 00000100:00100000:0.0:1790391796.319758:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 56 00000100:00100000:0.0:1790391796.319769:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+37:18836:x1877361169699200:12345-192.168.202.28@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790391796.319800:0:22776:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790391796.320576:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+37:18836:x1877361169699200:12345-192.168.202.28@tcp:53:lhsmtool_posix.0 Request processed in 806us (2090us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391796.320586:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 56 00000100:00100000:0.0:1790391796.345753:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391796.345854:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169699328 00000100:00100000:2.0:1790391796.345864:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169699328 00000100:00100000:2.0:1790391796.345965:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 57 00000100:00100000:2.0:1790391796.345975:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+37:18836:x1877361169699328:12345-192.168.202.28@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1790391796.346050:0:22777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efbc00/0x2b1b7949f13e3130 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.346067:0:22777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efbc00/0x2b1b7949f13e3130 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.346079:0:22777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efbc00/0x2b1b7949f13e3130 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.346149:0:22777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa600/0x2b1b7949f13e3137 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.346158:0:22777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa600/0x2b1b7949f13e3137 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.346165:0:22777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa600/0x2b1b7949f13e3137 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.346189:0:22777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e313e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.346214:0:22777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e313e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.346221:0:22777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e313e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391796.346427:0:22777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1790391796.346433:0:22777:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790391796.346448:0:22777:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e313e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.346458:0:22777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efbc00/0x2b1b7949f13e3130 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.346464:0:22777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efbc00/0x2b1b7949f13e3130 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.346482:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efbc00/0x2b1b7949f13e3130 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.346488:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52a7efbc00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391796.346492:0:22777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efbc00/0x2b1b7949f13e3130 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.346499:0:22777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efbc00/0x2b1b7949f13e3130 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.346687:0:22777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e52832fae00) 00010000:00010000:2.0:1790391796.346692:0:22777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391796.346698:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efbc00/0x2b1b7949f13e3130 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.346714:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efbc00/0x2b1b7949f13e3130 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.346729:0:22777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa600/0x2b1b7949f13e3137 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.346734:0:22777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa600/0x2b1b7949f13e3137 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.346739:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa600/0x2b1b7949f13e3137 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.346743:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52a7efa600 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391796.346747:0:22777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa600/0x2b1b7949f13e3137 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.346752:0:22777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa600/0x2b1b7949f13e3137 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.346760:0:22777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9e52b9b6c200) 00010000:00010000:2.0:1790391796.346762:0:22777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391796.346765:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa600/0x2b1b7949f13e3137 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.346770:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa600/0x2b1b7949f13e3137 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.346785:0:22777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e313e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.346790:0:22777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e313e lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.346802:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e313e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.346807:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52a7efa200 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391796.346810:0:22777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e313e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.346815:0:22777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e313e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.346822:0:22777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e51821ba600) 00010000:00010000:2.0:1790391796.346825:0:22777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391796.346827:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e313e lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.346832:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e313e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391796.347005:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+37:18836:x1877361169699328:12345-192.168.202.28@tcp:34:lhsmtool_posix.0 Request processed in 1029us (1261us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391796.347014:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 57 00000100:00100000:0.0:1790391796.357609:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391796.357755:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169699584 00000100:00100000:2.0:1790391796.357766:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169699584 00000100:00100000:2.0:1790391796.357829:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 58 00000100:00100000:2.0:1790391796.357837:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529233ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+37:18836:x1877361169699584:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790391796.357855:0:22776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391796.357873:0:22776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa400/0x2b1b7949f13e3145 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b083f expref: -99 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.357997:0:22776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efaa00/0x2b1b7949f13e314c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.358009:0:22776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efaa00/0x2b1b7949f13e314c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.358018:0:22776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efaa00/0x2b1b7949f13e314c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391796.358026:0:22776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790391796.358087:0:22776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efaa00/0x2b1b7949f13e314c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.358092:0:22776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efaa00/0x2b1b7949f13e314c lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.358097:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efaa00/0x2b1b7949f13e314c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.358100:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52a7efaa00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391796.358103:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efaa00/0x2b1b7949f13e314c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.358108:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efaa00/0x2b1b7949f13e314c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.358126:0:22776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e51821ba600) 00010000:00010000:2.0:1790391796.358128:0:22776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790391796.358132:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efaa00/0x2b1b7949f13e314c lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.358143:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efaa00/0x2b1b7949f13e314c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.358178:0:22776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa400/0x2b1b7949f13e3145 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b083f expref: 39 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.358185:0:22776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e52832fae00) 00010000:00010000:2.0:1790391796.358186:0:22776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790391796.358189:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa400/0x2b1b7949f13e3145 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b083f expref: 39 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.358194:0:22776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52a7efa400, rc 0) 00000100:00100000:2.0:1790391796.358259:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529233ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+38:18836:x1877361169699584:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 424us (661us total) trans 12884901915 rc 301/301 00000100:00100000:2.0:1790391796.358264:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 58 00000100:00100000:2.0:1790391796.364179:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391796.364267:0:23840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169699712 00000100:00100000:0.0:1790391796.364278:0:23840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169699712 00000100:00100000:0.0:1790391796.364720:0:23840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 59 00000100:00100000:0.0:1790391796.364732:0:23840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c67287cd-8d89-444e-807d-10aa5015d6e5+38:18836:x1877361169699712:12345-192.168.202.28@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790391796.364769:0:23840:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790391796.364923:0:23840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c67287cd-8d89-444e-807d-10aa5015d6e5+38:18836:x1877361169699712:12345-192.168.202.28@tcp:53:lhsmtool_posix.0 Request processed in 184us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391796.364931:0:23840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 59 00000100:00100000:0.0:1790391796.373138:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391796.373437:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169699968 00000100:00100000:2.0:1790391796.373447:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169699968 00000100:00100000:2.0:1790391796.373505:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 60 00000100:00100000:2.0:1790391796.373528:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292339c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+38:18836:x1877361169699968:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790391796.373549:0:22776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391796.373568:0:22776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e315a lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0846 expref: -99 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790391796.374036:0:22776:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x23:0x0], count =31 00000004:00080000:2.0:1790391796.374044:0:22776:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x23:0x0]+31 in llog 00000004:00080000:2.0:1790391796.374074:0:22776:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:2.0:1790391796.374225:0:22776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa600/0x2b1b7949f13e3161 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.375155:0:22776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa600/0x2b1b7949f13e3161 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.375177:0:22776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa600/0x2b1b7949f13e3161 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.376072:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e315a lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0846 expref: 41 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.376100:0:22776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa600/0x2b1b7949f13e3161 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0846 expref: 40 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.376110:0:22776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:2.0:1790391796.376113:0:22776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790391796.376116:0:22776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52a7efa600, rc 0) 00000100:00100000:2.0:1790391796.376201:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292339c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+40:18836:x1877361169699968:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 2686us (3072us total) trans 12884901916 rc 0/0 00000100:00100000:2.0:1790391796.376211:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 60 00000100:00100000:1.0:1790391796.390833:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391796.390950:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169700224 00000100:00100000:2.0:1790391796.390961:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169700224 00000100:00100000:2.0:1790391796.391026:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 61 00000100:00100000:2.0:1790391796.391036:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+40:18836:x1877361169700224:12345-192.168.202.28@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790391796.391094:0:22777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391796.391118:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa600/0x2b1b7949f13e3161 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0846 expref: 40 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.391155:0:22777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:2.0:1790391796.391167:0:22777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790391796.391188:0:22777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e316f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.391201:0:22777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e316f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.391212:0:22777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e316f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.391465:0:22777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa400/0x2b1b7949f13e3176 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xd6b42226 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.391475:0:22777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa400/0x2b1b7949f13e3176 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd6b42226 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.391483:0:22777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa400/0x2b1b7949f13e3176 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd6b42226 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.391667:0:22777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e316f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.391676:0:22777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e316f lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.391682:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e316f lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.391688:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52a7efa200 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391796.391692:0:22777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e316f lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.391706:0:22777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e316f lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.391715:0:22777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e5182c83300) 00010000:00010000:2.0:1790391796.391718:0:22777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391796.391722:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e316f lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.391729:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa200/0x2b1b7949f13e316f lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.391738:0:22777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa400/0x2b1b7949f13e3176 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd6b42226 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.391743:0:22777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa400/0x2b1b7949f13e3176 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd6b42226 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.391748:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa400/0x2b1b7949f13e3176 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd6b42226 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.391764:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52a7efa400 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391796.391766:0:22777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa400/0x2b1b7949f13e3176 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd6b42226 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.391772:0:22777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa400/0x2b1b7949f13e3176 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd6b42226 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.391778:0:22777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xd6b42226 (ffff9e52b9b6c900) 00010000:00010000:2.0:1790391796.391780:0:22777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391796.391783:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa400/0x2b1b7949f13e3176 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xd6b42226 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.391796:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa400/0x2b1b7949f13e3176 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xd6b42226 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391796.391982:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+39:18836:x1877361169700224:12345-192.168.202.28@tcp:36:lhsmtool_posix.0 Request processed in 945us (1159us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790391796.391990:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 61 00000100:00100000:3.0:1790391796.400457:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391796.400668:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169700352 00000100:00100000:2.0:1790391796.400680:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169700352 00000100:00100000:2.0:1790391796.400747:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 62 00000100:00100000:2.0:1790391796.400756:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288345880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c67287cd-8d89-444e-807d-10aa5015d6e5+39:18836:x1877361169700352:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790391796.400776:0:22778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391796.400800:0:22778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efaa00/0x2b1b7949f13e317d lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b084d expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.400837:0:22778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efbc00/0x2b1b7949f13e3184 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.400851:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efbc00/0x2b1b7949f13e3184 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.400863:0:22778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efbc00/0x2b1b7949f13e3184 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.401022:0:22778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efaa00/0x2b1b7949f13e317d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b084d expref: 41 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.401043:0:22778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efbc00/0x2b1b7949f13e3184 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b084d expref: 40 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.401063:0:22778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e52b9b6c500) 00010000:00010000:2.0:1790391796.401066:0:22778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790391796.401070:0:22778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52a7efbc00, rc 0) 00000100:00100000:2.0:1790391796.401137:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288345880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c67287cd-8d89-444e-807d-10aa5015d6e5+40:18836:x1877361169700352:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 382us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391796.401144:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 62 00000100:00100000:0.0:1790391796.408376:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391796.409207:0:23840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169700608 00000100:00100000:2.0:1790391796.409230:0:23840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169700608 00000100:00100000:2.0:1790391796.409304:0:23840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 63 00000100:00100000:2.0:1790391796.409315:0:23840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c67287cd-8d89-444e-807d-10aa5015d6e5+40:18836:x1877361169700608:12345-192.168.202.28@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790391796.409426:0:23840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e70c00/0x2b1b7949f13e318b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.409443:0:23840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e70c00/0x2b1b7949f13e318b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.409455:0:23840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e70c00/0x2b1b7949f13e318b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790391796.410480:0:23840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:2.0:1790391796.410498:0:23840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 709777619744ns, next at 710777616619ns, rc = 0 00000004:00010000:2.0:1790391796.411224:0:23840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000644fdf1f reply state 00000000d100b81c transno 12884901917 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e70c00/0x2b1b7949f13e318b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.411652:0:23840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e70c00/0x2b1b7949f13e318b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.411664:0:23840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e52b9b6c500) 00010000:00010000:2.0:1790391796.411677:0:23840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1790391796.411681:0:23840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790391796.411808:0:23840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c67287cd-8d89-444e-807d-10aa5015d6e5+42:18836:x1877361169700608:12345-192.168.202.28@tcp:36:lhsmtool_posix.0 Request processed in 2492us (3441us total) trans 12884901917 rc 0/0 00000100:00100000:2.0:1790391796.411817:0:23840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 63 00000100:00100000:0.0:1790391796.427962:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391796.428871:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169700736 00000100:00100000:2.0:1790391796.428901:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169700736 00000100:00100000:2.0:1790391796.428982:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 64 00000100:00100000:2.0:1790391796.428993:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a7f11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c67287cd-8d89-444e-807d-10aa5015d6e5+42:18836:x1877361169700736:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790391796.429017:0:22778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391796.429038:0:22778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71000/0x2b1b7949f13e3192 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0854 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.429099:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71000/0x2b1b7949f13e3192 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0854 expref: 43 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.429125:0:22778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71000/0x2b1b7949f13e3192 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0854 expref: 43 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.429145:0:22778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e52b9b6c500) 00010000:00010000:2.0:1790391796.429148:0:22778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790391796.429152:0:22778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52a7e71000, rc 0) 00000100:00100000:2.0:1790391796.429223:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a7f11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c67287cd-8d89-444e-807d-10aa5015d6e5+43:18836:x1877361169700736:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 232us (1270us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391796.429231:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 64 00000100:00100000:3.0:1790391796.432200:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391796.432352:0:24284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169700864 00000100:00100000:2.0:1790391796.432362:0:24284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169700864 00000100:00100000:2.0:1790391796.432426:0:24284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 23 00000100:00100000:2.0:1790391796.432447:0:24284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a4ad7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+5:2383:x1877361169700864:12345-192.168.202.28@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1790391796.432833:0:24284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a4ad7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+6:2383:x1877361169700864:12345-192.168.202.28@tcp:2:lhsmtool_posix.0 Request processed in 387us (641us total) trans 12884901891 rc 0/0 00000100:00100000:2.0:1790391796.432841:0:24284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 23 00000100:00100000:0.0:1790391796.444627:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391796.445629:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169701120 00000100:00100000:1.0:1790391796.445650:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169701120 00000100:00100000:1.0:1790391796.445733:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 11 00000100:00100000:1.0:1790391796.445744:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a7f12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+43:18836:x1877361169701120:12345-192.168.202.28@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790391796.446042:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a7f12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+44:18836:x1877361169701120:12345-192.168.202.28@tcp:35:lhsmtool_posix.0 Request processed in 299us (1449us total) trans 12884901918 rc 0/0 00000100:00100000:1.0:1790391796.446065:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 11 00000100:00100000:0.0:1790391796.458581:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391796.458726:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169701376 00000100:00100000:3.0:1790391796.458737:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169701376 00000100:00100000:3.0:1790391796.458799:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 65 00000100:00100000:3.0:1790391796.458809:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a7f10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+44:18836:x1877361169701376:12345-192.168.202.28@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790391796.458985:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a7f10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+44:18836:x1877361169701376:12345-192.168.202.28@tcp:57:lhsmtool_posix.0 Request processed in 177us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391796.458993:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 65 00000100:00100000:2.0:1790391796.474552:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391796.475265:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169701504 00000100:00100000:3.0:1790391796.475276:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169701504 00000100:00100000:3.0:1790391796.475343:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 66 00000100:00100000:3.0:1790391796.475353:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c67287cd-8d89-444e-807d-10aa5015d6e5+44:18836:x1877361169701504:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790391796.475388:0:22778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391796.475410:0:22778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031600/0x2b1b7949f13e3199 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b085b expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391796.475477:0:22778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e31a0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391796.475491:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e31a0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391796.475503:0:22778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e31a0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391796.475559:0:22778:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790391796.475579:0:22778:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e31a0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391796.475605:0:22778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031600/0x2b1b7949f13e3199 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b085b expref: 46 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391796.475623:0:22778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e31a0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b085b expref: 45 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391796.475632:0:22778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e52b9b6c500) 00010000:00010000:3.0:1790391796.475645:0:22778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1790391796.475649:0:22778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5280031400, rc 0) 00000100:00100000:3.0:1790391796.475715:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c67287cd-8d89-444e-807d-10aa5015d6e5+45:18836:x1877361169701504:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 364us (1175us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391796.475723:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 66 00000100:00100000:0.0:1790391796.484738:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391796.485091:0:24766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169701632 00000100:00100000:2.0:1790391796.485101:0:24766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169701632 00000100:00100000:2.0:1790391796.485162:0:24766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 24 00000100:00100000:2.0:1790391796.485173:0:24766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a7f12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c67287cd-8d89-444e-807d-10aa5015d6e5+6:2384:x1877361169701632:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790391796.485192:0:24766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391796.485224:0:24766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d5640c9/0x2b1b7949f13e31a7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0862 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790391796.485261:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6ab735f4, blocks: 0x0 00010000:00010000:2.0:1790391796.485280:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=709s v=(0 0) 00010000:00010000:2.0:1790391796.485285:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391796.485295:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d5640c9/0x2b1b7949f13e31a7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0862 expref: 7 pid: 24766 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.485315:0:24766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000d5640c9/0x2b1b7949f13e31a7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0862 expref: 7 pid: 24766 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.485328:0:24766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52a7e70e00, rc 0) 00000100:00100000:2.0:1790391796.485384:0:24766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a7f12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c67287cd-8d89-444e-807d-10aa5015d6e5+7:2384:x1877361169701632:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 213us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391796.485409:0:24766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 24 00000100:00100000:0.0:1790391796.492325:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391796.492453:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169701888 00000100:00100000:3.0:1790391796.492465:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169701888 00000100:00100000:3.0:1790391796.492535:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 67 00000100:00100000:3.0:1790391796.492544:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a7f12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+45:18836:x1877361169701888:12345-192.168.202.28@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790391796.492670:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a7f12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+45:18836:x1877361169701888:12345-192.168.202.28@tcp:57:lhsmtool_posix.0 Request processed in 126us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391796.492678:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 67 00000100:00100000:2.0:1790391796.502342:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391796.502695:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169702016 00000100:00100000:3.0:1790391796.502705:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169702016 00000100:00100000:3.0:1790391796.502834:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 68 00000100:00100000:3.0:1790391796.502859:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c67287cd-8d89-444e-807d-10aa5015d6e5+45:18836:x1877361169702016:12345-192.168.202.28@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1790391796.508399:0:22756:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000004:00080000:2.0:1790391796.508417:0:22756:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1790391796.508791:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1790391796.509209:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e2f31 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.509232:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e2f31 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.509241:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e2f31 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.509248:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763d800 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391796.509253:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e2f31 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.509261:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e2f31 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.509278:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9e52832fa200) 00010000:00010000:0.0:1790391796.509281:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391796.509286:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e2f31 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.509293:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e2f31 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.509318:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145c00/0x2b1b7949f13e2f38 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.509337:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145c00/0x2b1b7949f13e2f38 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.509344:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145c00/0x2b1b7949f13e2f38 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.509349:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295145c00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391796.509352:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145c00/0x2b1b7949f13e2f38 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.509358:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145c00/0x2b1b7949f13e2f38 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.509366:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e5182c83300) 00010000:00010000:0.0:1790391796.509369:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391796.509372:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145c00/0x2b1b7949f13e2f38 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.509378:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145c00/0x2b1b7949f13e2f38 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.509390:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ce00/0x2b1b7949f13e2fe0 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.509396:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ce00/0x2b1b7949f13e2fe0 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.509402:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ce00/0x2b1b7949f13e2fe0 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.509408:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52bab9ce00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391796.509415:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ce00/0x2b1b7949f13e2fe0 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.509422:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ce00/0x2b1b7949f13e2fe0 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.509429:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9e51821ba100) 00010000:00010000:0.0:1790391796.509431:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391796.509434:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ce00/0x2b1b7949f13e2fe0 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.509440:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ce00/0x2b1b7949f13e2fe0 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.509454:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa000/0x2b1b7949f13e309d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.509460:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa000/0x2b1b7949f13e309d lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.509467:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa000/0x2b1b7949f13e309d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.509472:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52a7efa000 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391796.509475:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa000/0x2b1b7949f13e309d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.509481:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa000/0x2b1b7949f13e309d lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.509488:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e51821ba600) 00010000:00010000:0.0:1790391796.509490:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391796.509508:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa000/0x2b1b7949f13e309d lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.509514:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efa000/0x2b1b7949f13e309d lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.509525:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb400/0x2b1b7949f13e30c0 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.509531:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb400/0x2b1b7949f13e30c0 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.509537:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb400/0x2b1b7949f13e30c0 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.509543:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52a7efb400 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391796.509546:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb400/0x2b1b7949f13e30c0 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.509552:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb400/0x2b1b7949f13e30c0 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.509559:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e51821ba600) 00010000:00010000:0.0:1790391796.509561:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391796.509564:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb400/0x2b1b7949f13e30c0 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.509916:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb400/0x2b1b7949f13e30c0 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.509932:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efac00/0x2b1b7949f13e3106 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.509939:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efac00/0x2b1b7949f13e3106 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.509950:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efac00/0x2b1b7949f13e3106 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.509956:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52a7efac00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391796.509959:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efac00/0x2b1b7949f13e3106 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.509966:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efac00/0x2b1b7949f13e3106 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.509974:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e51821ba600) 00010000:00010000:0.0:1790391796.509986:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391796.509989:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efac00/0x2b1b7949f13e3106 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.509996:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efac00/0x2b1b7949f13e3106 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.510008:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e70c00/0x2b1b7949f13e318b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.510013:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e70c00/0x2b1b7949f13e318b lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.510019:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e70c00/0x2b1b7949f13e318b lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.510024:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52a7e70c00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391796.510027:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e70c00/0x2b1b7949f13e318b lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.510042:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e70c00/0x2b1b7949f13e318b lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.510050:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e52b9b6c500) 00010000:00010000:0.0:1790391796.510052:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790391796.510055:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e70c00/0x2b1b7949f13e318b lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.510189:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e70c00/0x2b1b7949f13e318b lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790391796.510362:0:22756:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000100:00100000:3.0:1790391796.510480:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288344000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186588800:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1790391796.510846:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391796.511071:0:24285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186588800 00000100:00100000:3.0:1790391796.511081:0:24285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186588800 00000100:00100000:3.0:1790391796.511146:0:24285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790391796.511155:0:24285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186588800:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1790391796.511306:0:24285:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1790391796.511309:0:24285:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1790391796.511311:0:24285:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1790391796.511313:0:24285:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1790391796 -> 1790391796 00002000:00010000:3.0:1790391796.511315:0:24285:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1790391796.511362:0:24285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3638:x1877361186588800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 208us (518us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1790391796.511369:0:24285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1790391796.511620:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1790391796.511843:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e5288344000/2, rc 0, transno 12884901892 00000100:00100000:2.0:1790391796.511851:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288344000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186588800:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1790391796.512849:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c67287cd-8d89-444e-807d-10aa5015d6e5+14:18836:x1877361169702016:12345-192.168.202.28@tcp:44:lhsmtool_posix.0 Request processed in 10000us (10513us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391796.512859:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 68 00010000:00010000:0.0:1790391796.514295:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d800/0x2b1b7949f13e2f85 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.514309:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d800/0x2b1b7949f13e2f85 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.514318:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d800/0x2b1b7949f13e2f85 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.514324:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52bab9d800 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391796.514329:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d800/0x2b1b7949f13e2f85 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.514337:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d800/0x2b1b7949f13e2f85 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.514368:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e5182c83300) 00010000:00010000:0.0:1790391796.514371:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1790391796.514376:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d800/0x2b1b7949f13e2f85 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.514383:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d800/0x2b1b7949f13e2f85 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391796.518464:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391796.519388:0:24766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169702144 00000100:00100000:3.0:1790391796.519416:0:24766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169702144 00000100:00100000:3.0:1790391796.519477:0:24766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 26 00000100:00100000:3.0:1790391796.519487:0:24766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c67287cd-8d89-444e-807d-10aa5015d6e5+7:2382:x1877361169702144:12345-192.168.202.28@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1790391796.519943:0:24766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c67287cd-8d89-444e-807d-10aa5015d6e5+7:2382:x1877361169702144:12345-192.168.202.28@tcp:16:lhsmtool_posix.0 Request processed in 456us (1487us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391796.519951:0:24766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 26 00000100:00100000:2.0:1790391796.526043:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391796.526808:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169702400 00000100:00100000:3.0:1790391796.526897:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169702400 00000100:00100000:3.0:1790391796.527009:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 69 00000100:00100000:3.0:1790391796.527020:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+14:18836:x1877361169702400:12345-192.168.202.28@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790391796.527088:0:22777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391796.527114:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e31a0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b085b expref: 14 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391796.527133:0:22777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e52b9b6c500) 00010000:00010000:3.0:1790391796.527137:0:22777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790391796.527166:0:22777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031600/0x2b1b7949f13e31ae lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391796.527180:0:22777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031600/0x2b1b7949f13e31ae lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391796.527189:0:22777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031600/0x2b1b7949f13e31ae lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790391796.527311:0:22777:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009aa69930 reply state 00000000eb5e8731 transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031600/0x2b1b7949f13e31ae lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391796.527323:0:22777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031600/0x2b1b7949f13e31ae lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391796.527343:0:22777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e52b9b6c500) 00010000:00010000:3.0:1790391796.527346:0:22777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790391796.527349:0:22777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790391796.527458:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+15:18836:x1877361169702400:12345-192.168.202.28@tcp:36:lhsmtool_posix.0 Request processed in 438us (1424us total) trans 12884901919 rc 0/0 00000100:00100000:3.0:1790391796.527466:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 69 00000100:00100000:2.0:1790391796.535707:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391796.539769:0:24285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169702528 00000100:00100000:3.0:1790391796.539786:0:24285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169702528 00000100:00100000:3.0:1790391796.539855:0:24285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 27 00000100:00100000:3.0:1790391796.539866:0:24285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+7:18836:x1877361169702528:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790391796.539912:0:24285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391796.539933:0:24285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b769297/0x2b1b7949f13e31b5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0869 expref: -99 pid: 24285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391796.539968:0:24285:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000d5640c9/0x2b1b7949f13e31a7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0862 expref: 8 pid: 24766 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391796.540124:0:24285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391796.540130:0:24285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391796.540137:0:24285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b769297/0x2b1b7949f13e31b5 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0869 expref: 8 pid: 24285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391796.540177:0:24285:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000d5640c9/0x2b1b7949f13e31a7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0862 expref: 8 pid: 24766 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391796.540191:0:24285:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000d5640c9/0x2b1b7949f13e31a7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0862 expref: 8 pid: 24766 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391796.540222:0:24285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288346680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24285:1877361186588928:192.168.202.28@tcp:104: 00000100:00100000:3.0:1790391796.540322:0:24285:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a0b41a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790391796.550667:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391796.551180:0:24285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288346680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24285:1877361186588928:192.168.202.28@tcp:104: 00010000:00010000:3.0:1790391796.551215:0:24285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b769297/0x2b1b7949f13e31b5 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0869 expref: 8 pid: 24285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391796.551237:0:24285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5280031a00, rc 0) 00000100:00100000:3.0:1790391796.551298:0:24285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+8:18836:x1877361169702528:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 11432us (15601us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391796.551307:0:24285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 27 00000100:00100000:2.0:1790391796.551457:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169702656 00000100:00100000:2.0:1790391796.551464:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169702656 00010000:00010000:2.0:1790391796.551498:0:22762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000d5640c9/0x2b1b7949f13e31a7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0862 expref: 8 pid: 24766 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391796.551535:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 20 00000100:00100000:2.0:1790391796.551545:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+8:2383:x1877361169702656:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391796.551559:0:22762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391796.551582:0:22762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000d5640c9/0x2b1b7949f13e31a7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0862 expref: 8 pid: 24766 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.551594:0:22762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000d5640c9/0x2b1b7949f13e31a7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0862 expref: 8 pid: 24766 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.551645:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d5640c9/0x2b1b7949f13e31a7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0862 expref: 8 pid: 24766 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.551661:0:22762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391796.551665:0:22762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391796.551672:0:22762:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b769297/0x2b1b7949f13e31b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0869 expref: 7 pid: 24285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.551682:0:22762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b769297/0x2b1b7949f13e31b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0869 expref: 7 pid: 24285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.551717:0:22762:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003b769297/0x2b1b7949f13e31b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0869 expref: 7 pid: 24285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391796.551732:0:22762:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831bb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:22762:1877361186589056:192.168.202.28@tcp:105: 00000100:00100000:2.0:1790391796.551789:0:22762:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290bff300 going to sleep for 11 seconds 00010000:00010000:0.0:1790391796.552439:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391796.555014:0:22762:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831bb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:22762:1877361186589056:192.168.202.28@tcp:105: 00010000:00010000:0.0:1790391796.555044:0:22762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391796.555107:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+7:2383:x1877361169702656:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 3562us (4449us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391796.555117:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 20 00000100:00100000:0.0:1790391796.558555:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391796.558660:0:24286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169702784 00000100:00100000:3.0:1790391796.558670:0:24286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169702784 00000100:00100000:3.0:1790391796.558731:0:24286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 28 00000100:00100000:3.0:1790391796.558742:0:24286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a7f11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c67287cd-8d89-444e-807d-10aa5015d6e5+7:2383:x1877361169702784:12345-192.168.202.28@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1790391796.558929:0:24286:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1790391796.558933:0:24286:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1790391796 00002000:00010000:3.0:1790391796.558935:0:24286:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1790391794 00002000:00010000:3.0:1790391796.558938:0:24286:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1790391796 -> 1790391796 00002000:00010000:3.0:1790391796.558940:0:24286:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1790391796.561264:0:24286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a7f11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c67287cd-8d89-444e-807d-10aa5015d6e5+8:2383:x1877361169702784:12345-192.168.202.28@tcp:2:lhsmtool_posix.0 Request processed in 2512us (2706us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1790391796.561278:0:24286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 28 00000100:00100000:1.0:1790391796.577288:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391796.577396:0:24284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169702912 00000100:00100000:0.0:1790391796.577406:0:24284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169702912 00000100:00100000:0.0:1790391796.577471:0:24284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 29 00000100:00100000:0.0:1790391796.577481:0:24284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183828700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+8:2381:x1877361169702912:12345-192.168.202.28@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1790391796.577529:0:24284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000ef2ca91/0x2b1b7949f13e31bc lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.577548:0:24284:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b769297/0x2b1b7949f13e31b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0869 expref: 8 pid: 24285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.577556:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391796.577573:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790391796.577578:0:24284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ef2ca91/0x2b1b7949f13e31bc lrc: 4/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.577614:0:24284:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003b769297/0x2b1b7949f13e31b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0869 expref: 8 pid: 24285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.577629:0:24284:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003b769297/0x2b1b7949f13e31b5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0869 expref: 8 pid: 24285 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391796.577656:0:24284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52a7f11880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:24284:1877361186589184:192.168.202.28@tcp:104: 00000100:00100000:0.0:1790391796.577739:0:24284:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a7edfe40 going to sleep for 11 seconds 00000100:00100000:0.0:1790391796.582546:0:24284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52a7f11880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:24284:1877361186589184:192.168.202.28@tcp:104: 00010000:00010000:0.0:1790391796.582580:0:24284:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000ef2ca91/0x2b1b7949f13e31bc lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391796.589443:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391796.589544:0:25806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169703040 00000100:00100000:0.0:1790391796.589557:0:25806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169703040 00010000:00010000:0.0:1790391796.589600:0:25806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003b769297/0x2b1b7949f13e31b5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0869 expref: 9 pid: 24285 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391796.589651:0:25806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 21 00000100:00100000:0.0:1790391796.589661:0:25806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c67287cd-8d89-444e-807d-10aa5015d6e5+9:2383:x1877361169703040:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790391796.589677:0:25806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391796.589703:0:25806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003b769297/0x2b1b7949f13e31b5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0869 expref: 9 pid: 24285 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.589733:0:25806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003b769297/0x2b1b7949f13e31b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0869 expref: 9 pid: 24285 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.589757:0:25806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b769297/0x2b1b7949f13e31b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0869 expref: 9 pid: 24285 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.589775:0:25806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790391796.589779:0:25806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790391796.589785:0:25806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000ef2ca91/0x2b1b7949f13e31bc lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.589794:0:25806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ef2ca91/0x2b1b7949f13e31bc lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.589832:0:25806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391796.589927:0:25806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c67287cd-8d89-444e-807d-10aa5015d6e5+8:2383:x1877361169703040:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 267us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391796.589935:0:25806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 21 00010000:00010000:1.0:1790391796.590253:0:24284:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000ef2ca91/0x2b1b7949f13e31bc lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391796.590263:0:24284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ef2ca91/0x2b1b7949f13e31bc lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391796.590283:0:24284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000ef2ca91/0x2b1b7949f13e31bc lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391796.590291:0:24284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ef2ca91/0x2b1b7949f13e31bc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391796.590298:0:24284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ef2ca91/0x2b1b7949f13e31bc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391796.590304:0:24284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295145c00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:1.0:1790391796.590308:0:24284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ef2ca91/0x2b1b7949f13e31bc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391796.590317:0:24284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ef2ca91/0x2b1b7949f13e31bc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391796.590341:0:24284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ef2ca91/0x2b1b7949f13e31bc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391796.590348:0:24284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ef2ca91/0x2b1b7949f13e31bc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391796.590419:0:24284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183828700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+7:2381:x1877361169702912:12345-192.168.202.28@tcp:1:lhsmtool_posix.0 Request processed in 12939us (13142us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391796.590427:0:24284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 29 00000100:00100000:1.0:1790391796.599515:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391796.599613:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169703296 00000100:00100000:2.0:1790391796.599624:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169703296 00000100:00100000:2.0:1790391796.599683:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 70 00000100:00100000:2.0:1790391796.599692:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+15:18836:x1877361169703296:12345-192.168.202.28@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1790391796.599776:0:22776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e70a00/0x2b1b7949f13e31c3 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.599794:0:22776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb000/0x2b1b7949f13e3096 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0807 expref: 15 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.599817:0:22776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e70a00/0x2b1b7949f13e31c3 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.599853:0:22776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb000/0x2b1b7949f13e3096 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0807 expref: 15 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.599867:0:22776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb000/0x2b1b7949f13e3096 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0807 expref: 15 pid: 22776 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391796.599910:0:22776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831bb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22776:1877361186589312:192.168.202.28@tcp:104: 00000100:00100000:2.0:1790391796.600011:0:22776:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290bff300 going to sleep for 11 seconds 00000100:00100000:2.0:1790391796.606557:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391796.607187:0:22776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831bb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22776:1877361186589312:192.168.202.28@tcp:104: 00010000:00010000:3.0:1790391796.607241:0:22776:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e70a00/0x2b1b7949f13e31c3 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391796.613428:0:25807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169703424 00000100:00100000:0.0:1790391796.613447:0:25807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169703424 00010000:00010000:0.0:1790391796.613501:0:25807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb000/0x2b1b7949f13e3096 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0807 expref: 16 pid: 22776 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391796.614166:0:25807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 22 00000100:00100000:0.0:1790391796.614180:0:25807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c67287cd-8d89-444e-807d-10aa5015d6e5+16:2383:x1877361169703424:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790391796.614222:0:25807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391796.614231:0:25807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb000/0x2b1b7949f13e3096 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0807 expref: 16 pid: 22776 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.614247:0:25807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb000/0x2b1b7949f13e3096 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0807 expref: 16 pid: 22776 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.614269:0:25807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7efb000/0x2b1b7949f13e3096 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0807 expref: 16 pid: 22776 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.614289:0:25807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e51821ba600) 00010000:00010000:0.0:1790391796.614295:0:25807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030000/0x2b1b7949f13e3129 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0838 expref: 15 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.614306:0:25807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e70a00/0x2b1b7949f13e31c3 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.614314:0:25807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e70a00/0x2b1b7949f13e31c3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.614320:0:25807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e70a00/0x2b1b7949f13e31c3 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.614359:0:25807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790391796.614500:0:22776:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e70a00/0x2b1b7949f13e31c3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.614508:0:22776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e70a00/0x2b1b7949f13e31c3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.614717:0:22776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71800/0x2b1b7949f13e31ca lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.614730:0:22776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71000/0x2b1b7949f13e3192 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0854 expref: 16 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.614738:0:22776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71800/0x2b1b7949f13e31ca lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.614771:0:22776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71000/0x2b1b7949f13e3192 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0854 expref: 16 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.614793:0:22776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71000/0x2b1b7949f13e3192 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0854 expref: 16 pid: 22778 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391796.614807:0:22776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ac380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22776:1877361186589440:192.168.202.28@tcp:104: 00000100:00100000:0.0:1790391796.614874:0:25807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c67287cd-8d89-444e-807d-10aa5015d6e5+16:2383:x1877361169703424:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 696us (8325us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391796.614918:0:25807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 22 00000100:00100000:2.0:1790391796.625277:0:22776:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290bff300 going to sleep for 11 seconds 00000100:00100000:1.0:1790391796.637391:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391796.637554:0:22776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ac380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22776:1877361186589440:192.168.202.28@tcp:104: 00010000:00010000:3.0:1790391796.637582:0:22776:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71800/0x2b1b7949f13e31ca lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391796.637970:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169703552 00000100:00100000:0.0:1790391796.637987:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169703552 00010000:00010000:0.0:1790391796.638042:0:22762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71000/0x2b1b7949f13e3192 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0854 expref: 16 pid: 22778 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391796.638094:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 23 00000100:00100000:0.0:1790391796.638104:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+16:2383:x1877361169703552:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790391796.638119:0:22762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391796.638128:0:22762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71000/0x2b1b7949f13e3192 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0854 expref: 16 pid: 22778 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.638140:0:22762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71000/0x2b1b7949f13e3192 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0854 expref: 16 pid: 22778 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.638166:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71000/0x2b1b7949f13e3192 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0854 expref: 16 pid: 22778 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.638184:0:22762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e52b9b6c500) 00010000:00010000:0.0:1790391796.638189:0:22762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71800/0x2b1b7949f13e31ca lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.638198:0:22762:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71800/0x2b1b7949f13e31ca lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.638206:0:22762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71800/0x2b1b7949f13e31ca lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.638398:0:22762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391796.638450:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+15:2383:x1877361169703552:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 347us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391796.638458:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 23 00010000:00010000:3.0:1790391796.638558:0:22776:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71800/0x2b1b7949f13e31ca lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391796.638566:0:22776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71800/0x2b1b7949f13e31ca lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790391796.638696:0:22776:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901920 00000001:00080000:3.0:1790391796.638814:0:22776:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:3.0:1790391796.638851:0:22776:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901922 00000100:00100000:3.0:1790391796.638963:0:22776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288346680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22776:1877361186589568:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1790391796.639032:0:22776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391796.639076:0:22776:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e8ba540 going to sleep for 11 seconds 00000100:00100000:0.0:1790391796.643757:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186589568 00000100:00100000:0.0:1790391796.643773:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186589568 00000100:00100000:0.0:1790391796.643844:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790391796.643855:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288347480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22776:x1877361186589568:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790391796.644032:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288347480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22776:x1877361186589568:12345-0@lo:1000:mdt00_000.0 Request processed in 178us (4999us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391796.644039:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790391796.644184:0:22776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288346680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22776:1877361186589568:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1790391796.644390:0:22776:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:3.0:1790391796.644461:0:22776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288346680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22776:1877361186589696:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1790391796.644501:0:22776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391796.644530:0:22776:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a7e54900 going to sleep for 11 seconds 00000100:00100000:0.0:1790391796.646537:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186589696 00000100:00100000:0.0:1790391796.646551:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186589696 00000100:00100000:0.0:1790391796.646604:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790391796.646613:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288344e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22776:x1877361186589696:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790391796.646836:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288344e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22776:x1877361186589696:12345-0@lo:1000:mdt00_000.0 Request processed in 223us (2333us total) trans 12884901894 rc 0/0 00000100:00100000:0.0:1790391796.646843:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790391796.646944:0:22776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288346680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22776:1877361186589696:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1790391796.646995:0:22776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71800/0x2b1b7949f13e31ca lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391796.647007:0:22776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71800/0x2b1b7949f13e31ca lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391796.647015:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71800/0x2b1b7949f13e31ca lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391796.647020:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52a7e71800 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:1.0:1790391796.647025:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71800/0x2b1b7949f13e31ca lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391796.647032:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71800/0x2b1b7949f13e31ca lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391796.647076:0:22776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e52b9b6c500) 00010000:00010000:1.0:1790391796.647079:0:22776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790391796.647085:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71800/0x2b1b7949f13e31ca lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391796.647092:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71800/0x2b1b7949f13e31ca lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391796.647128:0:22776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030e00/0x2b1b7949f13e3122 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391796.647135:0:22776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030e00/0x2b1b7949f13e3122 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391796.647140:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030e00/0x2b1b7949f13e3122 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391796.647145:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280030e00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:1.0:1790391796.647147:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030e00/0x2b1b7949f13e3122 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391796.647154:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030e00/0x2b1b7949f13e3122 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391796.647161:0:22776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e51821ba600) 00010000:00010000:1.0:1790391796.647164:0:22776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790391796.647171:0:22776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030000/0x2b1b7949f13e3129 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0838 expref: 18 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391796.647182:0:22776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030000/0x2b1b7949f13e3129 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0838 expref: 18 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391796.647197:0:22776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030000/0x2b1b7949f13e3129 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0838 expref: 18 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391796.647372:0:22776:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030000/0x2b1b7949f13e3129 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0838 expref: 18 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391796.647386:0:22776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183829880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22776:1877361186589824:192.168.202.28@tcp:105: 00000100:00100000:1.0:1790391796.647454:0:22776:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a097c480 going to sleep for 11 seconds 00000100:00100000:1.0:1790391796.655069:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391796.655219:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169703680 00000100:00100000:0.0:1790391796.655228:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169703680 00000100:00100000:0.0:1790391796.655281:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 12 00000100:00100000:0.0:1790391796.655291:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+19:18835:x1877361169703680:12345-192.168.202.28@tcp:49:bash.0 00000100:00100000:0.0:1790391796.655417:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+19:18835:x1877361169703680:12345-192.168.202.28@tcp:49:bash.0 Request processed in 127us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391796.655425:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 12 00000100:00100000:3.0:1790391796.657032:0:22776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183829880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22776:1877361186589824:192.168.202.28@tcp:105: 00010000:00010000:3.0:1790391796.657065:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030e00/0x2b1b7949f13e3122 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391796.657076:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030e00/0x2b1b7949f13e3122 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391796.657130:0:22776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e31d1 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391796.657143:0:22776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e31d1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391796.657154:0:22776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e31d1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391796.657163:0:22776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e31d1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391796.657169:0:22776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e31d1 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391796.657175:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e31d1 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391796.657180:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280031400 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391796.657184:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e31d1 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391796.657191:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e31d1 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391796.657201:0:22776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e51821ba600) 00010000:00010000:3.0:1790391796.657204:0:22776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391796.657220:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e31d1 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391796.657227:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e31d1 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391796.657244:0:22776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e70a00/0x2b1b7949f13e31c3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391796.657250:0:22776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e70a00/0x2b1b7949f13e31c3 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391796.657257:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e70a00/0x2b1b7949f13e31c3 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391796.657262:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52a7e70a00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391796.657265:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e70a00/0x2b1b7949f13e31c3 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391796.657272:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e70a00/0x2b1b7949f13e31c3 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391796.657281:0:22776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e51821ba600) 00010000:00010000:3.0:1790391796.657284:0:22776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790391796.657288:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e70a00/0x2b1b7949f13e31c3 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391796.657293:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e70a00/0x2b1b7949f13e31c3 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391796.657764:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+18:18836:x1877361169703296:12345-192.168.202.28@tcp:57:lhsmtool_posix.0 Request processed in 58071us (58258us total) trans 12884901924 rc 0/0 00000100:00100000:3.0:1790391796.657772:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 70 00000020:00080000:3.0:1790391796.657777:0:22776:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1790391796.658662:0:22810:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1790391796.658668:0:22810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790391796.658687:0:22810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1790391796.658693:0:22810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1790391796.668764:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391796.668864:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169703936 00000100:00100000:0.0:1790391796.668912:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169703936 00000100:00100000:0.0:1790391796.668960:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 13 00000100:00100000:0.0:1790391796.668969:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+18:18836:x1877361169703936:12345-192.168.202.28@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1790391796.669269:0:22780:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1790391796.669320:0:22780:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901925 00010000:00010000:0.0:1790391796.669355:0:22780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145400/0x2b1b7949f13e31d8 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.669373:0:22780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145400/0x2b1b7949f13e31d8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.669384:0:22780:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145400/0x2b1b7949f13e31d8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.669392:0:22780:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145400/0x2b1b7949f13e31d8 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.669399:0:22780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145400/0x2b1b7949f13e31d8 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.669405:0:22780:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145400/0x2b1b7949f13e31d8 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.669433:0:22780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790391796.669535:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+20:18836:x1877361169703936:12345-192.168.202.28@tcp:35:lhsmtool_posix.0 Request processed in 565us (778us total) trans 12884901926 rc 0/0 00000100:00100000:0.0:1790391796.669543:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 13 00000020:00080000:0.0:1790391796.669548:0:22780:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790391796.669914:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391796.669921:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145400/0x2b1b7949f13e31d8 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.669929:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295145400 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:2.0:1790391796.669935:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145400/0x2b1b7949f13e31d8 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.669943:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145400/0x2b1b7949f13e31d8 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.669955:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e52b9b6c500) 00010000:00010000:2.0:1790391796.669958:0:22765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790391796.669963:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145400/0x2b1b7949f13e31d8 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.669969:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145400/0x2b1b7949f13e31d8 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.669992:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391796.670002:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391796.670004:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391796.671649:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391796.671764:0:24766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169704064 00000100:00100000:2.0:1790391796.671773:0:24766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169704064 00000100:00100000:2.0:1790391796.671823:0:24766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 30 00000100:00100000:2.0:1790391796.671830:0:24766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288346300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c67287cd-8d89-444e-807d-10aa5015d6e5+7:18835:x1877361169704064:12345-192.168.202.28@tcp:101:bash.0 00010000:00010000:2.0:1790391796.671844:0:24766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391796.671859:0:24766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000499d7aa0/0x2b1b7949f13e31df lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0870 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790391796.671903:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x6ab735f4, atime: 0x6ab735f2, ctime: 0x6ab735f4, blocks: 0x0 00010000:00010000:2.0:1790391796.671933:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=710s v=(0 0) 00010000:00010000:2.0:1790391796.671937:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391796.671947:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000499d7aa0/0x2b1b7949f13e31df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0870 expref: 8 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.671975:0:24766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000499d7aa0/0x2b1b7949f13e31df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0870 expref: 8 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.671987:0:24766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52a7e70600, rc 0) 00000100:00100000:2.0:1790391796.672042:0:24766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288346300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c67287cd-8d89-444e-807d-10aa5015d6e5+8:18835:x1877361169704064:12345-192.168.202.28@tcp:101:bash.0 Request processed in 211us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391796.672048:0:24766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 30 00000100:00100000:3.0:1790391796.674187:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391796.674343:0:23840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169704192 00000100:00100000:0.0:1790391796.674353:0:23840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169704192 00000100:00100000:0.0:1790391796.674406:0:23840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 71 00000100:00100000:0.0:1790391796.674415:0:23840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288347800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c67287cd-8d89-444e-807d-10aa5015d6e5+20:18835:x1877361169704192:12345-192.168.202.28@tcp:101:bash.0 00010000:00010000:0.0:1790391796.674437:0:23840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391796.674455:0:23840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145600/0x2b1b7949f13e31e6 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0877 expref: -99 pid: 23840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.674500:0:23840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144400/0x2b1b7949f13e31ed lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.674514:0:23840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144400/0x2b1b7949f13e31ed lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.674525:0:23840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144400/0x2b1b7949f13e31ed lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.674626:0:23840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145600/0x2b1b7949f13e31e6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0877 expref: 22 pid: 23840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.674656:0:23840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144400/0x2b1b7949f13e31ed lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0877 expref: 21 pid: 23840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391796.674665:0:23840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e51821ba600) 00010000:00010000:0.0:1790391796.674668:0:23840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790391796.674672:0:23840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5295144400, rc 0) 00000100:00100000:0.0:1790391796.674726:0:23840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288347800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c67287cd-8d89-444e-807d-10aa5015d6e5+21:18835:x1877361169704192:12345-192.168.202.28@tcp:101:bash.0 Request processed in 311us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391796.674733:0:23840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 71 00000100:00100000:1.0:1790391796.677485:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391796.677724:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169704448 00000100:00100000:0.0:1790391796.677735:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169704448 00000100:00100000:0.0:1790391796.677839:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 14 00000100:00100000:0.0:1790391796.677851:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+21:18835:x1877361169704448:12345-192.168.202.28@tcp:35:bash.0 00000001:00080000:0.0:1790391796.678098:0:22780:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901927 00000001:00080000:0.0:1790391796.678187:0:22780:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901928 00000100:00100000:0.0:1790391796.678289:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+24:18835:x1877361169704448:12345-192.168.202.28@tcp:35:bash.0 Request processed in 439us (812us total) trans 12884901929 rc 0/0 00000100:00100000:0.0:1790391796.678307:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 14 00000020:00080000:0.0:1790391796.678312:0:22780:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1790391796.772481:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391796.775946:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169704704 00000100:00100000:0.0:1790391796.775962:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169704704 00000100:00100000:0.0:1790391796.776039:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 72 00000100:00100000:2.0:1790391796.776291:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c67287cd-8d89-444e-807d-10aa5015d6e5+24:18846:x1877361169704704:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:2.0:1790391796.776320:0:22778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391796.776343:0:22778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e70800/0x2b1b7949f13e31f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b087e expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391796.776459:0:22778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1790391796.776553:0:22778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e70800/0x2b1b7949f13e31f4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b087e expref: 26 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.776568:0:22778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e51821bad00) 00010000:00010000:2.0:1790391796.776572:0:22778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790391796.776577:0:22778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e70800/0x2b1b7949f13e31f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b087e expref: 26 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.776592:0:22778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52a7e70800, rc 0) 00000100:00100000:2.0:1790391796.777851:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c67287cd-8d89-444e-807d-10aa5015d6e5+25:18846:x1877361169704704:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 1795us (5372us total) trans 12884901930 rc 301/301 00000100:00100000:2.0:1790391796.777871:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 72 00000100:00100000:3.0:1790391796.790800:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391796.791421:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169704832 00000100:00100000:2.0:1790391796.791433:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169704832 00000100:00100000:2.0:1790391796.791496:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 73 00000100:00100000:2.0:1790391796.791507:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+25:18846:x1877361169704832:12345-192.168.202.28@tcp:34:lfs.0 00010000:00010000:2.0:1790391796.791589:0:22777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e70800/0x2b1b7949f13e3202 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.792016:0:22777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e70800/0x2b1b7949f13e3202 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.792029:0:22777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e70800/0x2b1b7949f13e3202 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.792043:0:22777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71200/0x2b1b7949f13e3209 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.792061:0:22777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71200/0x2b1b7949f13e3209 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.792065:0:22777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71200/0x2b1b7949f13e3209 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.792138:0:22777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71e00/0x2b1b7949f13e3210 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.792147:0:22777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71e00/0x2b1b7949f13e3210 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.792154:0:22777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71e00/0x2b1b7949f13e3210 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790391796.792201:0:22777:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71e00/0x2b1b7949f13e3210 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.792292:0:22777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e70800/0x2b1b7949f13e3202 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.792297:0:22777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e70800/0x2b1b7949f13e3202 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.792302:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e70800/0x2b1b7949f13e3202 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.792305:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52a7e70800 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391796.792309:0:22777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e70800/0x2b1b7949f13e3202 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.792313:0:22777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e70800/0x2b1b7949f13e3202 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.792330:0:22777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e5182c83300) 00010000:00010000:2.0:1790391796.792332:0:22777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391796.792335:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e70800/0x2b1b7949f13e3202 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.792340:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e70800/0x2b1b7949f13e3202 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.792350:0:22777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71200/0x2b1b7949f13e3209 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.792353:0:22777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71200/0x2b1b7949f13e3209 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.792357:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71200/0x2b1b7949f13e3209 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.792360:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52a7e71200 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391796.792362:0:22777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71200/0x2b1b7949f13e3209 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.792365:0:22777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71200/0x2b1b7949f13e3209 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.792368:0:22777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9e52b9b6c600) 00010000:00010000:2.0:1790391796.792369:0:22777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391796.792371:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71200/0x2b1b7949f13e3209 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.792374:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71200/0x2b1b7949f13e3209 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.792396:0:22777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71e00/0x2b1b7949f13e3210 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.792401:0:22777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71e00/0x2b1b7949f13e3210 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.792407:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71e00/0x2b1b7949f13e3210 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.792411:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52a7e71e00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391796.792414:0:22777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71e00/0x2b1b7949f13e3210 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.792419:0:22777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71e00/0x2b1b7949f13e3210 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.792427:0:22777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e51821ba600) 00010000:00010000:2.0:1790391796.792430:0:22777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391796.792433:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71e00/0x2b1b7949f13e3210 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391796.792439:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52a7e71e00/0x2b1b7949f13e3210 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391796.792511:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+25:18846:x1877361169704832:12345-192.168.202.28@tcp:34:lfs.0 Request processed in 1005us (1719us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391796.792518:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 73 00000100:00100000:1.0:1790391796.798489:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391796.798987:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169705088 00000100:00100000:3.0:1790391796.798997:0:22779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169705088 00000100:00100000:3.0:1790391796.799049:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 15 00000100:00100000:3.0:1790391796.799060:0:22779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+25:18846:x1877361169705088:12345-192.168.202.28@tcp:35:lfs.0 00000100:00100000:3.0:1790391796.799276:0:22779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+26:18846:x1877361169705088:12345-192.168.202.28@tcp:35:lfs.0 Request processed in 218us (794us total) trans 12884901931 rc 0/0 00000100:00100000:3.0:1790391796.799281:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 15 00000100:00100000:0.0:1790391797.256953:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790391797.256979:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186589952:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790391797.257059:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391797.257306:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186589952 00000100:00100000:1.0:1790391797.257315:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186589952 00000100:00100000:1.0:1790391797.257373:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790391797.257383:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a7f11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186589952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790391797.257419:0:22782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:1.0:1790391797.257481:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a7f11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186589952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391797.257488:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790391797.257578:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186589952:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790391797.258735:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790391797.258751:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52a7f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186590080:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790391797.258797:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391797.258917:0:24288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186590080 00000100:00100000:0.0:1790391797.258924:0:24288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186590080 00000100:00100000:0.0:1790391797.258991:0:24288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790391797.258999:0:24288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186590080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790391797.259026:0:24288:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1790391797.259074:0:24288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186590080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391797.259081:0:24288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790391797.259124:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52a7f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186590080:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1790391797.259286:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790391797.577123:0:22764:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391797.769445:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186590208:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790391797.769518:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391797.769704:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186590208 00000100:00100000:1.0:1790391797.769713:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186590208 00000100:00100000:1.0:1790391797.769784:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790391797.769794:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186590208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790391797.769834:0:22782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790391797.769919:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186590208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391797.769926:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790391797.769972:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186590208:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790391798.280208:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790391798.280232:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186590336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790391798.280302:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391798.280422:0:24288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186590336 00000100:00100000:2.0:1790391798.280430:0:24288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186590336 00000100:00100000:2.0:1790391798.280495:0:24288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790391798.280505:0:24288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1877361186590336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790391798.280528:0:24288:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1790391798.280579:0:24288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1877361186590336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391798.280586:0:24288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790391798.280644:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186590336:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790391798.280814:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790391798.610082:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790391798.614492:0:25861:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:1.0:1790391798.794250:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790391798.794274:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186590464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790391798.794350:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391798.794413:0:24288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186590464 00000100:00100000:1.0:1790391798.794429:0:24288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186590464 00000100:00100000:1.0:1790391798.794486:0:24288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790391798.794496:0:24288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186590464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790391798.794524:0:24288:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1790391798.794568:0:24288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186590464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391798.794576:0:24288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1790391798.794597:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790391798.794646:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186590464:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790391798.795352:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e907dcd1-fffe-43bb-853f-376b925bb229:3639:1877361186590592:0@lo:400:kworker.0 00000100:00100000:2.0:1790391798.795397:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391798.795643:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186591104:0@lo:400:kworker.0 00000100:00100000:2.0:1790391798.795673:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391798.795690:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb39b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1877361186591616:0@lo:400:kworker.0 00000100:00100000:2.0:1790391798.795713:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391798.795736:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186592128:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790391798.795759:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391798.795774:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1790391798.795781:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186590720:0@lo:400:kworker.0 00000100:00100000:2.0:1790391798.795800:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391798.795817:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518331dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186591232:0@lo:400:kworker.0 00000100:00100000:2.0:1790391798.795839:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391798.795856:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb399500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1877361186591744:0@lo:400:kworker.0 00000100:00100000:2.0:1790391798.795927:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391798.795955:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186591104 00000100:00100000:2.0:1790391798.795961:0:22781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186591104 00000100:00100000:2.0:1790391798.795992:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186590720 00000100:00100000:2.0:1790391798.795994:0:22781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186590720 00000100:00100000:2.0:1790391798.796010:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790391798.796018:0:22781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186591104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391798.796063:0:22781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186591104:12345-0@lo:400:kworker.0 Request processed in 44us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391798.796084:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790391798.796102:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790391798.796109:0:22781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf94ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186590720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391798.796137:0:22781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf94ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186590720:12345-0@lo:400:kworker.0 Request processed in 29us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391798.796143:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790391798.796161:0:24285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186591232 00000100:00100000:2.0:1790391798.796164:0:24285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186591232 00000100:00100000:2.0:1790391798.796187:0:24285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790391798.796193:0:24285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf949c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186591232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391798.796222:0:24285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf949c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186591232:12345-0@lo:400:kworker.0 Request processed in 30us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391798.796332:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186590592 00000100:00100000:3.0:1790391798.796337:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186590592 00000100:00100000:3.0:1790391798.796365:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1790391798.796372:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+24:3639:x1877361186590592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391798.796426:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e907dcd1-fffe-43bb-853f-376b925bb229+24:3639:x1877361186590592:12345-0@lo:400:kworker.0 Request processed in 46us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391798.796432:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1790391798.796462:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186591616 00000100:00100000:3.0:1790391798.796466:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186591616 00000100:00100000:3.0:1790391798.796496:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186591744 00000100:00100000:3.0:1790391798.796499:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186591744 00000100:00100000:3.0:1790391798.796519:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790391798.796525:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877361186591616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391798.796555:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877361186591616:12345-0@lo:400:kworker.0 Request processed in 30us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391798.796568:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790391798.796580:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790391798.796585:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877361186591744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391798.796626:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877361186591744:12345-0@lo:400:kworker.0 Request processed in 41us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391798.796632:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790391798.799781:0:24285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790391798.799856:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877361186590976:0@lo:400:kworker.0 00000100:00100000:2.0:1790391798.799950:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391798.799992:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb39bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877361186591488:0@lo:400:kworker.0 00000100:00100000:2.0:1790391798.800015:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391798.800049:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb398a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1877361186592000:0@lo:400:kworker.0 00000100:00100000:2.0:1790391798.800073:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391798.800094:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1790391798.800100:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186590848:0@lo:400:kworker.0 00000100:00100000:2.0:1790391798.800125:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391798.800149:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186591360:0@lo:400:kworker.0 00000100:00100000:2.0:1790391798.800170:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391798.800185:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bb39a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1877361186591872:0@lo:400:kworker.0 00000100:00100000:2.0:1790391798.800206:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391798.800475:0:24284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186590848 00000100:00100000:1.0:1790391798.800484:0:24284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186590848 00000100:00100000:1.0:1790391798.801853:0:24284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186591360 00000100:00100000:1.0:1790391798.801865:0:24284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186591360 00000100:00100000:2.0:1790391798.801985:0:24766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790391798.801997:0:24766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3638:x1877361186590848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391798.802088:0:24766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3638:x1877361186590848:12345-0@lo:400:kworker.0 Request processed in 94us (1961us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391798.802095:0:24766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790391798.802111:0:24766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790391798.802118:0:24766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186591360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391798.802147:0:24766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186591360:12345-0@lo:400:kworker.0 Request processed in 30us (1977us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391798.802153:0:24766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790391798.802176:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186590976 00000100:00100000:2.0:1790391798.806042:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186590976 00000100:00100000:2.0:1790391798.806113:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186591488 00000100:00100000:2.0:1790391798.806116:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186591488 00000100:00100000:2.0:1790391798.806131:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186592000 00000100:00100000:2.0:1790391798.806134:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186592000 00000100:00100000:2.0:1790391798.806149:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186591872 00000100:00100000:2.0:1790391798.806151:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186591872 00000100:00100000:2.0:1790391798.806186:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790391798.806207:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877361186590976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391798.806297:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877361186590976:12345-0@lo:400:kworker.0 Request processed in 91us (6347us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391798.806304:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790391798.806320:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790391798.806326:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877361186591488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391798.806356:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877361186591488:12345-0@lo:400:kworker.0 Request processed in 31us (6340us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391798.806361:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790391798.806373:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790391798.806379:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877361186592000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391798.806563:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877361186592000:12345-0@lo:400:kworker.0 Request processed in 37us (6342us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391798.806573:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790391798.806587:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790391798.806593:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877361186591872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391798.806644:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877361186591872:12345-0@lo:400:kworker.0 Request processed in 51us (6436us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391798.806650:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790391798.806709:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186590848:0@lo:400:kworker.0 00000100:00100000:2.0:1790391798.806724:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186591360:0@lo:400:kworker.0 00000100:00100000:2.0:1790391798.806735:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb39a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1877361186591872:0@lo:400:kworker.0 00000100:00100000:2.0:1790391798.806746:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877361186590976:0@lo:400:kworker.0 00000100:00100000:2.0:1790391798.806769:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb39bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877361186591488:0@lo:400:kworker.0 00010000:00080000:2.0:1790391798.806782:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52bb398a80 x1877361186592000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391798.806792:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb398a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1877361186592000:0@lo:400:kworker.0 00000100:00100000:2.0:1790391798.806843:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186590720:0@lo:400:kworker.0 00000100:00100000:2.0:1790391798.806856:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518331dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186591232:0@lo:400:kworker.0 00010000:00080000:2.0:1790391798.806867:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52bb399500 x1877361186591744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391798.806902:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb399500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1877361186591744:0@lo:400:kworker.0 00000100:00100000:2.0:1790391798.806914:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e907dcd1-fffe-43bb-853f-376b925bb229:3639:1877361186590592:0@lo:400:kworker.0 00000100:00100000:2.0:1790391798.806926:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186591104:0@lo:400:kworker.0 00000100:00100000:2.0:1790391798.806937:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bb39b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1877361186591616:0@lo:400:kworker.0 00000100:00080000:1.0:1790391798.815092:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790391798.815102:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790391798.815106:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790391798.815132:0:24288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186592128 00000100:00100000:1.0:1790391798.815143:0:24288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186592128 00000100:00100000:1.0:1790391798.816208:0:24288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790391798.816223:0:24288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf948700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186592128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790391798.816259:0:24288:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1790391798.816351:0:24288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf948700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186592128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 132us (20590us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391798.816358:0:24288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790391798.816448:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186592128:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1790391799.624324:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391800.210057:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391800.210393:0:24289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169705216 00000100:00100000:0.0:1790391800.210406:0:24289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169705216 00002000:00100000:0.0:1790391800.210551:0:24289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x42:0x0] (0->8) req@ffff9e5181cb9f80 x1877361169705216/t0(0) o4->c67287cd-8d89-444e-807d-10aa5015d6e5@192.168.202.28@tcp:666/0 lens 504/0 e 0 to 0 dl 1790391811 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1790391800.210563:0:24289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e5181cb9f80 with x1877361169705216 ext(0->8) 00002000:00010000:0.0:1790391800.210595:0:24289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e5181cb9f80 00000100:00100000:0.0:1790391800.210639:0:24289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 0 00000100:00100000:0.0:1790391800.210650:0:24289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+8:2383:x1877361169705216:12345-192.168.202.28@tcp:4:bash.0 00000100:00100000:0.0:1790391800.212609:0:24289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c67287cd-8d89-444e-807d-10aa5015d6e5+10:2383:x1877361169705216:12345-192.168.202.28@tcp:4:bash.0 Request processed in 1941us (2545us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1790391800.212622:0:24289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 0 00002000:00100000:0.0:1790391800.212633:0:24289:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x42:0x0] (0->8) req@ffff9e5181cb9f80 x1877361169705216/t12884901895(0) o4->c67287cd-8d89-444e-807d-10aa5015d6e5@192.168.202.28@tcp:666/0 lens 504/448 e 0 to 0 dl 1790391811 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1790391800.212642:0:24289:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e5181cb9f80 with x1877361169705216 ext(0->8) 00002000:00010000:0.0:1790391800.212648:0:24289:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e5181cb9f80 00000100:00080000:1.0:1790391800.212783:0:22772:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790391800.217788:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391800.217873:0:24285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169705344 00000100:00100000:2.0:1790391800.217965:0:24285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169705344 00000100:00100000:2.0:1790391800.218026:0:24285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 31 00000100:00100000:2.0:1790391800.218038:0:24285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a7f13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+10:2384:x1877361169705344:12345-192.168.202.28@tcp:16:kworker.0 00000001:00080000:0.0:1790391800.220216:0:24280:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00000001:00080000:0.0:1790391800.220233:0:24280:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00000100:00100000:2.0:1790391800.220459:0:24285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a7f13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c67287cd-8d89-444e-807d-10aa5015d6e5+6:2384:x1877361169705344:12345-192.168.202.28@tcp:16:kworker.0 Request processed in 2417us (2675us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391800.220470:0:24285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 31 Debug log: 14872 lines, 14872 kept, 0 dropped, 0 bad.